Needle-in-a-Haystack Retrieval on Needle-in-a-Haystack 8K context (test)
100AccuracyQuest
Evaluation results
| Method | Links | |
|---|---|---|
| QuestModel=Fast-dLLM 7B, Budget K=1K2026.02 | 100 | |
| QuestModel=Fast-dLLM 7B, Budget K=2K2026.02 | 100 | |
| QuestModel=Fast-dLLM 7B, Budget K=4K2026.02 | 100 | |
| TidalModel=Fast-dLLM 7B, Budget K=4K2026.02 | 100 | |
| MAGEModel=Fast-dLLM 7B, Budget K=1K2026.02 | 100 | |
| MAGEModel=Fast-dLLM 7B, Budget K=2K2026.02 | 100 | |
| MAGEModel=Fast-dLLM 7B, Budget K=4K2026.02 | 100 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=4K2026.02 | 100 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=4K2026.02 | 97 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=4K2026.02 | 97 | |
| MAGEModel=Fast-dLLM 7B, Budget K=5122026.02 | 94 | |
| QuestModel=Fast-dLLM 7B, Budget K=5122026.02 | 91 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=2K2026.02 | 91 | |
| QuestModel=Fast-dLLM 7B, Budget K=2562026.02 | 88 | |
| TidalModel=Fast-dLLM 7B, Budget K=2562026.02 | 85 | |
| MAGEModel=Fast-dLLM 7B, Budget K=2562026.02 | 85 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=2K2026.02 | 85 | |
| TidalModel=Fast-dLLM 7B, Budget K=2K2026.02 | 82 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=2K2026.02 | 82 | |
| TidalModel=Fast-dLLM 7B, Budget K=1K2026.02 | 76 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=1K2026.02 | 70 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=1K2026.02 | 70 | |
| TidalModel=Fast-dLLM 7B, Budget K=5122026.02 | 67 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=1K2026.02 | 67 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=5122026.02 | 64 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=5122026.02 | 55 | |
| MAGEModel=Fast-dLLM 1.5B, Budget K=2562026.02 | 48 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=5122026.02 | 42 | |
| QuestModel=Fast-dLLM 1.5B, Budget K=2562026.02 | 33 | |
| TidalModel=Fast-dLLM 1.5B, Budget K=2562026.02 | 21 |