List your company
ResearchFormerly WizWand

Language Model Training Efficiency on Pajama

3,477.07ThroughputHSAP
869.9461,546.79552,223.6452,900.4945Jun 29, 2026
Updated 4mo ago

Evaluation results

MethodLinks
HSAPContext Length=32K, Topology (intraSPxinterSP)=8x12026.063,477.070.94
HSAPContext Length=64K, Topology (intraSPxinterSP)=4x22026.063,312.260.45
HSAPContext Length=16K, Topology (intraSPxinterSP)=1x82026.062,693.441.46
PackingContext Length=32K, Topology (intraSPxinterSP)=8x12026.062,522.720.68
BatchingContext Length=32K, Topology (intraSPxinterSP)=8x12026.062,511.990.68
PackingContext Length=16K, Topology (intraSPxinterSP)=1x82026.062,0051.09
BatchingContext Length=16K, Topology (intraSPxinterSP)=1x82026.062,003.361.09
PackingContext Length=64K, Topology (intraSPxinterSP)=4x22026.061,438.610.2
BatchingContext Length=64K, Topology (intraSPxinterSP)=4x22026.06970.220.2