NOSA
Benchmarks
TaskDatasetSOTA resultTrendResults
NOSA-8B 32K context length
2,312.1Throughput (tok/s)
24
NOSA-8B 64K context length
1,996.3Throughput (tok/s)
21
NOSA-8B
20,438.9Prefill Throughput (tok/s)
20
NOSA-8B 96K context length
1,694.1Throughput (tok/s)
19
NOSA-8B 128K context length
1,463.3Throughput (tok/s)
16