KEP-766: Add DisaggregatedSet proposal (#767)
* KEP-766: DisaggregatedSet proposal DisaggregatedSet is a higher-level CRD that orchestrates multiple LeaderWorkerSets for disaggregated inference workloads (e.g., prefill and decode phases running on separate infrastructure). Key features: - Manages 2-10 phases as a single logical unit - N-dimensional coordinated rolling updates using linear interpolation - Auto-created headless Services per phase per revision for load balancer integration (e.g., llm-d can count pods per revision to route traffic proportionally) * Update KEP-766: rename phase to role Rename all API terminology from "phase" to "role" throughout the KEP: - DisaggregatedPhaseSpec → DisaggregatedRoleSpec - spec.phases → spec.roles - disaggregatedset.x-k8s.io/phase → disaggregatedset.x-k8s.io/role - Update all documentation references The term "role" better describes the semantic meaning (prefill, decode, etc.) and aligns with common usage in disaggregated inference literature. Note: "phases of inference" in the motivation section is retained as it refers to the actual LLM inference phases, not the API terminology. * Add LeaderWorkerSetTemplateSpec type to KEP Use LeaderWorkerSetTemplateSpec (similar to PodTemplateSpec) instead of embedding LeaderWorkerSetSpec directly. This type needs to be added to the LWS API and contains metadata + spec fields.
M
Mathis Felardos committed
4f5dc0e8f71f5eacd711aac584309c82140b6dec
Parent: 80970f2
Committed by GitHub <noreply@github.com>
on 3/26/2026, 6:56:17 PM