Bending The Kubernetes Scheduler

Krea wanted its computing jobs to use available local GPUs before spilling into external capacity. Its Kubernetes scheduler, which assigns jobs to machines, instead favored an external-capacity node advertising abundant resources. Krea's engineering account describes adding a scheduling restriction whenever local GPUs are available and removing it when capacity remains scarce long enough.

Returning jobs also requires care. Krea uses controlled evictions that respect configured limits on disruption, rather than moving every external job simultaneously. The design depends on an accurate capacity signal: the team reports that an outdated signal can leave jobs waiting even when external capacity should be available.