The format that wins is the one with a kernel, not the one with the smallest file

A precision is only fast if the hardware executes it natively and the runtime has a kernel that does. Otherwise the tensor is stored small and widened on every use, which buys capacity and costs throughput, and the two get reported as one number.

15 MIN · PREMIUM