Multi-hop QA on HotpotQA (HpQA) Wiki18 index (test)
59.1Pass@4Gemma3-12B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma3-12BSampling Method=DivInit (DI)2026.06 | 59.1 | |
| Qwen3-8BSampling Method=DivInit (DI)2026.06 | 57 | |
| Gemma3-12BSampling Method=Standard parallel sampling (S)2026.06 | 54.9 | |
| Qwen3-4BSampling Method=DivInit (DI)2026.06 | 53.2 | |
| Qwen3-8BSampling Method=Standard parallel sampling (S)2026.06 | 50.4 | |
| Gemma3-4BSampling Method=DivInit (DI)2026.06 | 49.2 | |
| Qwen3-1.7BSampling Method=DivInit (DI)2026.06 | 43.8 | |
| Qwen3-1.7BSampling Method=Standard parallel sampling (S)2026.06 | 42.9 | |
| Qwen3-4BSampling Method=Standard parallel sampling (S)2026.06 | 41.9 | |
| Gemma3-4BSampling Method=Standard parallel sampling (S)2026.06 | 40 |