Long-context language tasks (MC, QA, Sum) on ∞Bench
78.6MC AccuracyRAG
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RAGContext Length=32k2026.01 | 78.6 | 29.3 | 25.1 | |
| RR+Judge(y)Context Type=Full Context, Max Length=1M tokens2026.01 | 72.5 | 30.7 | 31.7 | |
| BaseContext Type=Full Context, Max Length=1M tokens2026.01 | 72 | 30 | 31.2 | |
| RID(y)Context Type=Full Context, Max Length=1M tokens2026.01 | 71.6 | 34.7 | 29.7 | |
| RID+C(y)Context Type=Full Context, Max Length=1M tokens2026.01 | 70.7 | 31.3 | 30.2 | |
| RID+Q(y)Context Type=Full Context, Max Length=1M tokens2026.01 | 70.7 | 30.8 | 30.5 | |
| RAO(y)Context Type=Full Context, Max Length=1M tokens2026.01 | 70.3 | 38.2 | 31 | |
| RAO(y)Context Type=KV-Cache with RetrievalAttn2026.01 | 65.5 | 33.6 | 28 | |
| RID(y)Context Type=KV-Cache with RetrievalAttn2026.01 | 64.2 | 29.3 | 26 | |
| RR+Judge(y)Context Type=KV-Cache with RetrievalAttn2026.01 | 63.8 | 28.2 | 28.8 | |
| RID+C(y)Context Type=KV-Cache with RetrievalAttn2026.01 | 63.3 | 27.1 | 27.7 | |
| RID+Q(y)Context Type=KV-Cache with RetrievalAttn2026.01 | 62.9 | 27.1 | 28.1 | |
| BaseContext Type=KV-Cache with RetrievalAttn2026.01 | 62 | 27.6 | 27.3 |