Batching is a scheduling decision, not a configuration flag
Every batching design answers three questions: when a request may join, when it must leave, and what happens when the queue grows faster than the batch drains. Setting a batch size answers none of them, which is why tuning it alone rarely fixes anything.
13 MIN · PLUS
a free account unlocks the core curriculum tier · no card
