» Cedana / Kubernetes / Scavenger queue
Turn idle GPUs into capacity. Automatically.
Cedana turns your cluster’s idle time into finished batch work. Long-running jobs run as low-priority pods in the gaps; when a priority pod arrives, the Kubernetes scheduler preempts, Cedana checkpoints inside the grace period, the Job is re-created, and the workload resumes where it stopped on the next free GPU, on any node. Completely automated. Priority always comes first. No scripts, no schedules, no code changes.
Results from a 28.9-hour run
Measured · not simulatedThe following results are from a single continuous 28.9-hour run on an AWS EKS cluster with 8 NVIDIA A10G GPUs across two nodes. Eight scavenger workloads ran as Jobs in a low-priority PriorityClass; 729 high-priority Jobs preempted them through the stock kube-scheduler, which normally kills the pod and loses all progress.
Here, Cedana checkpointed each workload at preemption to shared EFS and automatically restores it on idle GPU windows, often on the other node. It detects idle capacity automatically.
Priority jobs used 29% of the cluster’s GPU time, leaving 71% idle. The scavenger workloads were preempted 630 times, every one restored from its newest checkpoint, and all eight ran to completion. One checkpoint was lost to a backend restart and cost seven minutes of redone work; nothing else was lost.
Of the idle GPU time, 68% was converted to useful work (99% while jobs were waiting), with 11% spent on checkpoint and restore. The median handover, measured from a priority pod’s submission to its start, was 28 seconds across all 729 priority pods, and 322 of the restores migrated onto a different node.
of 0.0 h idle GPU time so far
Cedana saved 0.0 h
SOURCE: pod accounting, the Cedana daemon and propagator event stream, the kube-scheduler’s Preempted events, and the job PROGRESS logs of run eks-pre-24h-5 (2026-11-02 03:22:10 UTC) · Amazon EKS v1.35.8 · 2 × g5.12xlarge · 8 × A10G · cedana-helm-0.9.406 · termination grace 120 s. Restore phase runs from pod start to “workload up”; checkpoint phase from “dump starting” to “dump completed”. Progress is each job’s own PROGRESS counter. Every preemption is paired with the priority pod the scheduler named. The “without checkpointing” bar is simulated: the same preemption times with the job restarting from zero each time.