Multi-hop QA on Bamboogle Wiki18 index (test)
64.3Pass@4Gemma3-12B
Evaluation results
| Method | Links | |
|---|---|---|
| Gemma3-12BSampling Method=DivInit (DI)2026.06 | 64.3 | |
| Qwen3-8BSampling Method=DivInit (DI)2026.06 | 57.6 | |
| Gemma3-12BSampling Method=Standard parallel sampling (S)2026.06 | 55.7 | |
| Qwen3-8BSampling Method=Standard parallel sampling (S)2026.06 | 47.7 | |
| Qwen3-4BSampling Method=DivInit (DI)2026.06 | 40.8 | |
| Gemma3-4BSampling Method=DivInit (DI)2026.06 | 37.9 | |
| Qwen3-4BSampling Method=Standard parallel sampling (S)2026.06 | 32.5 | |
| Gemma3-4BSampling Method=Standard parallel sampling (S)2026.06 | 27.7 | |
| Qwen3-1.7BSampling Method=DivInit (DI)2026.06 | 24.3 | |
| Qwen3-1.7BSampling Method=Standard parallel sampling (S)2026.06 | 16.8 |