Long-context Understanding on LongBench MuSiQue
22.32F1 ScoreDoc2Atom
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Doc2AtomLLM Backbone=Qwen3-4B-Instruct, Evaluation Protocol=Zero-shot2026.06 | 22.32 | 22.27 | |
| Base+ctxLLM Backbone=Gemma-2-2B-It, Evaluation Protocol=Zero-shot2026.06 | 21.62 | 21.62 | |
| Doc2AtomLLM Backbone=Gemma-2-2B-It, Evaluation Protocol=Zero-shot2026.06 | 20.86 | 20.86 | |
| Base+ctxLLM Backbone=Qwen3-4B-Instruct, Evaluation Protocol=Zero-shot2026.06 | 18.14 | 18.05 | |
| D2LrawLLM Backbone=Qwen3-4B-Instruct, Evaluation Protocol=Zero-shot2026.06 | 12.25 | 12.25 | |
| D2LckptLLM Backbone=Gemma-2-2B-It, Evaluation Protocol=Zero-shot2026.06 | 9.14 | 9.14 | |
| D2LatomLLM Backbone=Gemma-2-2B-It, Evaluation Protocol=Zero-shot2026.06 | 7.39 | 7.39 | |
| D2LrawLLM Backbone=Gemma-2-2B-It, Evaluation Protocol=Zero-shot2026.06 | 6.95 | 6.95 | |
| D2LatomLLM Backbone=Qwen3-4B-Instruct, Evaluation Protocol=Zero-shot2026.06 | 6.41 | 6.41 | |
| D2LckptLLM Backbone=Qwen3-4B-Instruct, Evaluation Protocol=Zero-shot2026.06 | 5.24 | 5 |