Long-context generation
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
329.61Throughput
32
Jun 25, 2026
393.9Throughput
32
Jun 25, 2026
486.5Throughput
32
Jun 25, 2026
553.79Throughput
32
Jun 25, 2026
23.94QMSum
22
Mar 10, 2026
5.89Throughput Speedup (α)
12
Feb 26, 2026
6.02Throughput Speedup (α)
12
Feb 26, 2026
5.37Throughput Speedup (α)
12
Feb 26, 2026
4.37Throughput Speedup (α)
12
Feb 26, 2026
3.73Throughput Speedup (α)
12
Feb 26, 2026
2.76Throughput Speedup (α)
12
Feb 26, 2026
6.29Throughput Speedup (micro)
6
Feb 26, 2026
5.79Throughput Speedup (micro)
6
Feb 26, 2026
5.46Throughput Speedup (micro)
6
Feb 26, 2026
4.75Throughput Speedup (micro)
6
Feb 26, 2026
4Throughput Speedup (micro)
6
Feb 26, 2026
2.92Throughput Speedup (micro-averaged)
6
Feb 26, 2026
97.627Completion Rate
3
Apr 14, 2026