AI Infra Interviews logo

Gang scheduling exists to prevent one specific deadlock

A distributed job needs every worker before any worker can progress. A scheduler that places them one at a time will hand out most of a job's devices and then stall, holding capacity that produces nothing and blocking the job that would have released it.

13 MIN · PLUS

a free account unlocks the core curriculum tier · no card