Map the mesh so the chattiest dimension takes the shortest path

A process mesh is a logical shape and the machine is a physical hierarchy, and the mapping between them is a decision. Get it right and the expensive collectives stay on the fast links; get it wrong and the same layout on the same hardware runs several times slower.

14 MIN · PREMIUM