LLM Decoding Throughput on NOSA-8B 32K context length benchmark leaderboard · SOTA2 Research

LLM Decoding Throughput on NOSA-8B 32K context length

2,312.1Throughput (tok/s)SparDA

Evaluation Results

Method	Links
SparDA2026.06		2,312.1
Sparse2026.06		2,145.5
SparDA2026.06		2,106.6
Sparse2026.06		1,861.6
SparDA2026.06		1,579.9
Sparse2026.06		1,244.9
Sparse2026.06		947.1
SparDA2026.06		873.2
Sparse2026.06		795.8
Sparse2026.06		488.1
Sparse2026.06		478
Dense2026.06		439.7
SparDA2026.06		433.2
InfiniGen2026.06		356.5
Dense2026.06		350.7
InfiniGen2026.06		269.9
Dense2026.06		252
Sparse2026.06		244
Sparse2026.06		241.3
SparDA2026.06		214.7
InfiniGen2026.06		205.9
InfiniGen2026.06		166
InfiniGen2026.06		120.3
InfiniGen2026.06		82