Long-context Question Answering on NarrQA 128K (Acc, F1)
21AccuracyRECONTEXT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RECONTEXTBackbone=Qwen3-8B2026.07 | 21 | 35 | |
| VanillaBackbone=Qwen3-8B2026.07 | 19 | 33 | |
| AttnSharpBackbone=Qwen3-8B2026.07 | 18 | 34 | |
| DySCOBackbone=Qwen3-8B2026.07 | 18 | 33 | |
| A-MEMBackbone=Qwen3-8B2026.07 | 17 | 31 | |
| RECONTEXTBackbone=Llama3-8B2026.07 | 17 | 29 | |
| DACBackbone=Llama3-8B2026.07 | 16 | 30 | |
| A-MEMBackbone=Llama3-8B2026.07 | 15 | 29 | |
| DACBackbone=Qwen3-8B2026.07 | 14 | 28 | |
| VanillaBackbone=Llama3-8B2026.07 | 13 | 27 | |
| AttnSharpBackbone=Llama3-8B2026.07 | 13 | 27 | |
| DySCOBackbone=Llama3-8B2026.07 | 13 | 26 | |
| RECONTEXTBackbone=Qwen3-4B2026.07 | 7 | 21 | |
| DACBackbone=Qwen3-4B2026.07 | 5 | 20 | |
| A-MEMBackbone=Qwen3-4B2026.07 | 4 | 19 | |
| AttnSharpBackbone=Qwen3-4B2026.07 | 3 | 17 | |
| VanillaBackbone=Qwen3-4B2026.07 | 2 | 17 | |
| DySCOBackbone=Qwen3-4B2026.07 | 1 | 17 |