Long-context Multiple Choice Question Answering on InfMC 128K
64AccuracyVanilla
Evaluation results
| Method | Links | |
|---|---|---|
| VanillaBackbone=Qwen3-8B2026.07 | 64 | |
| DACBackbone=Qwen3-8B2026.07 | 64 | |
| RECONTEXTBackbone=Llama3-8B2026.07 | 64 | |
| DySCOBackbone=Qwen3-8B2026.07 | 63 | |
| RECONTEXTBackbone=Qwen3-8B2026.07 | 63 | |
| AttnSharpBackbone=Qwen3-8B2026.07 | 60 | |
| A-MEMBackbone=Qwen3-8B2026.07 | 58 | |
| AttnSharpBackbone=Llama3-8B2026.07 | 57 | |
| VanillaBackbone=Llama3-8B2026.07 | 56 | |
| DySCOBackbone=Llama3-8B2026.07 | 56 | |
| RECONTEXTBackbone=Qwen3-4B2026.07 | 55 | |
| A-MEMBackbone=Llama3-8B2026.07 | 54 | |
| VanillaBackbone=Qwen3-4B2026.07 | 51 | |
| DySCOBackbone=Qwen3-4B2026.07 | 50 | |
| DACBackbone=Llama3-8B2026.07 | 49 | |
| AttnSharpBackbone=Qwen3-4B2026.07 | 47 | |
| A-MEMBackbone=Qwen3-4B2026.07 | 43 | |
| DACBackbone=Qwen3-4B2026.07 | 43 |