Needle-in-a-Haystack Retrieval on Needle-in-a-Haystack 32K context (test)
76AccuracyQuest
Evaluation results
| Method | Links | |
|---|---|---|
| QuestModel=Fast-dLLM 7B, Budget K=4K2026.02 | 76 | |
| QuestModel=Fast-dLLM 7B, Budget K=1K2026.02 | 73 | |
| QuestModel=Fast-dLLM 7B, Budget K=2K2026.02 | 73 | |
| MAGEModel=Fast-dLLM 7B, Budget K=4K2026.02 | 70 | |
| MAGEModel=Fast-dLLM 7B, Budget K=2K2026.02 | 64 | |
| TidalModel=Fast-dLLM 7B, Budget K=4K2026.02 | 61 | |
| MAGEModel=Fast-dLLM 7B, Budget K=1K2026.02 | 61 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=4K2026.02 | 55 | |
| QuestModel=Fast-dLLM 7B, Budget K=5122026.02 | 45 | |
| MAGEModel=Fast-dLLM 7B, Budget K=5122026.02 | 45 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=2K2026.02 | 42 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=4K2026.02 | 42 | |
| MAGEModel=Fast-dLLM 7B, Budget K=2562026.02 | 39 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=1K2026.02 | 39 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=2K2026.02 | 36 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=4K2026.02 | 33 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=5122026.02 | 30 | |
| QuestModel=Fast-dLLM 7B, Budget K=2562026.02 | 27 | |
| TidalModel=Fast-dLLM 7B, Budget K=5122026.02 | 27 | |
| TidalModel=Fast-dLLM 7B, Budget K=1K2026.02 | 27 | |
| TidalModel=Fast-dLLM 7B, Budget K=2K2026.02 | 27 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=1K2026.02 | 24 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=2K2026.02 | 24 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=2562026.02 | 21 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=2562026.02 | 18 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=5122026.02 | 18 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=1K2026.02 | 18 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=5122026.02 | 15 | |
| TidalModel=Fast-dLLM 7B, Budget K=2562026.02 | 12 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=2562026.02 | 12 |