Long-context Question Answering on NQ 128K (Acc, F1)
19AccuracyRECONTEXT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RECONTEXTBackbone=Llama3-8B2026.07 | 19 | 31 | |
| A-MEMBackbone=Llama3-8B2026.07 | 16 | 34 | |
| VanillaBackbone=Llama3-8B2026.07 | 15 | 29 | |
| AttnSharpBackbone=Llama3-8B2026.07 | 15 | 28 | |
| RECONTEXTBackbone=Qwen3-8B2026.07 | 13 | 33 | |
| DACBackbone=Qwen3-8B2026.07 | 12 | 29 | |
| DySCOBackbone=Llama3-8B2026.07 | 10 | 26 | |
| DySCOBackbone=Qwen3-8B2026.07 | 9 | 30 | |
| RECONTEXTBackbone=Qwen3-4B2026.07 | 8 | 25 | |
| A-MEMBackbone=Qwen3-8B2026.07 | 8 | 28 | |
| VanillaBackbone=Qwen3-8B2026.07 | 6 | 26 | |
| AttnSharpBackbone=Qwen3-8B2026.07 | 6 | 26 | |
| DACBackbone=Llama3-8B2026.07 | 6 | 23 | |
| VanillaBackbone=Qwen3-4B2026.07 | 2 | 21 | |
| AttnSharpBackbone=Qwen3-4B2026.07 | 2 | 21 | |
| DySCOBackbone=Qwen3-4B2026.07 | 2 | 21 | |
| A-MEMBackbone=Qwen3-4B2026.07 | 2 | 20 | |
| DACBackbone=Qwen3-4B2026.07 | 2 | 18 |