Multi-hop Question Answering on 2WikiMHQA in-distribution
79.39Exact Match (EM)CRAFT7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CRAFT7BType=Trained, CRAFT version=v4, Training Mode=RL2026.02 | 79.39 | 85.14 | 94.1 | |
| Gemini-2.5-FlashType=API, CRAFT version=v42026.02 | 70.6 | 79.41 | 97.8 | |
| Qwen3-30BType=Pre-Trained, CRAFT version=v42026.02 | 70.35 | 79.04 | 95.95 | |
| Deepseek-V3.2Type=API, CRAFT version=v42026.02 | 70.35 | 79.35 | 98.55 | |
| GPT-5-miniType=API, CRAFT version=v42026.02 | 70.05 | 81.09 | 97.1 | |
| Qwen3-4BType=Pre-Trained, CRAFT version=v42026.02 | 65.4 | 74.61 | 93.9 | |
| Qwen2.5-7BType=Trained, CRAFT version=v4, Training Mode=SFT2026.02 | 63.15 | 72 | 82.25 | |
| Qwen2.5-7BType=Pre-Trained, CRAFT version=v42026.02 | 60.8 | 70.2 | 86.15 | |
| Qwen2.5-3BType=Trained, CRAFT version=v4, Training Mode=SFT2026.02 | 55.9 | 64.77 | 74.1 | |
| CRAFT3BType=Trained, CRAFT version=v4, Training Mode=RL2026.02 | 55.68 | 64.18 | 82 | |
| CRAFT1.5BType=Trained, CRAFT version=v4, Training Mode=RL2026.02 | 44.22 | 51.33 | 48.96 | |
| Qwen2.5-3BType=Pre-Trained, CRAFT version=v42026.02 | 41.95 | 50.67 | 60.8 | |
| Qwen2.5-1.5BType=Trained, CRAFT version=v4, Training Mode=SFT2026.02 | 36.3 | 43.53 | 42.7 | |
| CRAFT0.5BType=Trained, CRAFT version=v4, Training Mode=RL2026.02 | 24.7 | 30.94 | 26.5 | |
| Qwen2.5-0.5BType=Trained, CRAFT version=v4, Training Mode=SFT2026.02 | 23.15 | 28.68 | 26.85 | |
| Qwen2.5-1.5BType=Pre-Trained, CRAFT version=v42026.02 | 21.65 | 28.33 | 31.15 | |
| Qwen2.5-0.5BType=Pre-Trained, CRAFT version=v42026.02 | 5.05 | 9.98 | 8 |