Multi-hop Numeric Reasoning QA on HotpotQA Dynamic Numeric Reasoning suite
2,252Tokens (No-adv)Qwen-Plus
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen-PlusModel=Qwen-plus2026.01 | 2,252 | 1 | 54 | 55,665.35 | 24.72 | 78 | 98.5 | 92.5 | 80 | 43.451 | |
| DS V32Model=DeepSeek-V3.22026.01 | 1,548.68 | 1 | 57 | 10,720.52 | 6.92 | 72 | 96 | 78 | 63.5 | 20.702 | |
| Gemini 2.5 FlashModel=Gemini-2.5-Flash2026.01 | 940.68 | 1 | 50 | 9,795.03 | 10.41 | 62 | 98.5 | 88 | 71 | 21.749 | |
| GPT-5.1Model=GPT-5.12026.01 | 447.29 | 1 | 72 | 3,375.65 | 7.55 | 81 | 97.5 | 84 | 51 | 13.211 | |
| DS R1Model=DeepSeek-R1-05282026.01 | 382.66 | 1 | 50 | 7,995.64 | 20.79 | 75 | 100 | 98.99 | 93.97 | 24.805 |