Multi-hop QA on MuSiQue Wiki18 index (test)
36.1Pass@4Gemma3-12B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma3-12BSampling Method=DivInit (DI)2026.06 | 36.1 | |
| Gemma3-12BSampling Method=Standard parallel sampling (S)2026.06 | 31.6 | |
| Qwen3-8BSampling Method=DivInit (DI)2026.06 | 29.7 | |
| Qwen3-8BSampling Method=Standard parallel sampling (S)2026.06 | 23.9 | |
| Qwen3-4BSampling Method=DivInit (DI)2026.06 | 19.7 | |
| Gemma3-4BSampling Method=Standard parallel sampling (S)2026.06 | 17.2 | |
| Gemma3-4BSampling Method=DivInit (DI)2026.06 | 16.1 | |
| Qwen3-4BSampling Method=Standard parallel sampling (S)2026.06 | 15.9 | |
| Qwen3-1.7BSampling Method=DivInit (DI)2026.06 | 15.6 | |
| Qwen3-1.7BSampling Method=Standard parallel sampling (S)2026.06 | 14.5 |