LoginSchedule demo
cedana / blog · field reports & engineering deep-dives

Writing from the
cedana team.

Engineering notes, benchmarks, and field reports covering how we build the automation layer for AI factories.
01Featured
Blueprint schematic of an eight-GPU node accumulating session state, with a state gauge rising toward the VRAM capacity lineBlueprint schematic of an eight-GPU node accumulating session state, with a state gauge rising toward the VRAM capacity line
FeaturedEngineering

The Era of Stateful Inference: how to improve cost per token.

We are entering the stateful inference era, driven by frontier models with longer context windows, longer in-flight sessions, and single instances spanning 8, 16, or more GPUs.

Jul 14, 2026· Cedana Editorial
read →
02Editor’s picks · 04
Blueprint fleet of GPU cells with only a third lit, next to a utilization gauge stuck at a dashed 30 percent ceiling and a second gauge breaking through itBlueprint fleet of GPU cells with only a third lit, next to a utilization gauge stuck at a dashed 30 percent ceiling and a second gauge breaking through it
Engineering

The Utilization Ceiling: Why AI and HPC Schedulers Hit 30% and How to Fix This

Nov 12, 2025
Blueprint timeline of two jobs crossing a 24-hour wall-time boundary: one is terminated and restarts from zero, the other checkpoints and continues into the next allocationBlueprint timeline of two jobs crossing a 24-hour wall-time boundary: one is terminated and restarts from zero, the other checkpoints and continues into the next allocation
Engineering

The Wall-Time Limit forces an expensive tradeoff in HPC.

Aug 12, 2026
Blueprint roofline plot: performance rises along the memory-bandwidth slope to a ridge point, then flattens at the compute ceilingBlueprint roofline plot: performance rises along the memory-bandwidth slope to a ridge point, then flattens at the compute ceiling
Engineering

Roofline Analysis and the Inference Value Chain

Jul 29, 2026
Blueprint of live migration: a dashed reclaimed spot instance, an accent state block in flight, and a healthy instance holding the restored stateBlueprint of live migration: a dashed reclaimed spot instance, an accent state block in flight, and a healthy instance holding the restored state
How-To

Using Cedana to Live-Migrate Stateful Workloads Between Spot Instances

Nov 2, 2024
03All posts · 08

insights from the team.

Field reports, engineering deep-dives, and benchmarks from the Cedana team.

Blueprint chart of three trajectories diverging from a point, with an accent curve rising steeply off the chartBlueprint chart of three trajectories diverging from a point, with an accent curve rising steeply off the chart
Field Report

The Fork in the Road Post GPT-5

On GPT-5 being underwhelming, scaling laws and where we can get reasonable progress from. Also, should AGI still be the goal?

Aug 14, 2025 · Niranjan Ravichandra
Blueprint molecule graph connected by an arrow to a four-GPU compute nodeBlueprint molecule graph connected by an arrow to a four-GPU compute node
Field Report

Supercharging Scientific Computing with Cedana

How we leverage open-source tech (like Kueue) to push scientific compute and accelerate time to insights.

Jun 9, 2025 · Niranjan Ravichandra