Open-Domain QA on SituatedQA Nq=300
44.6AccuracyGemini3Pro
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gemini3ProNq=3002026.02 | 44.6 | 0.584 | 0.594 | 0.685 | 61.6 | 12.7 | 48.9 | |
| KimiK2Nq=3002026.02 | 37.3 | 0.631 | 0.59 | 0.752 | 64.3 | 13.8 | 50.5 | |
| PooledNq=15002026.02 | 31.8 | 0.567 | 0.573 | 0.641 | 46.8 | 13.3 | 33.5 | |
| Claude4.5SNq=3002026.02 | 30.7 | 0.502 | 0.569 | 0.495 | 44.4 | 19.5 | 24.9 | |
| GPT-OSSNq=3002026.02 | 25.7 | 0.66 | 0.634 | 0.758 | 44.4 | 3.1 | 41.3 | |
| Qwen3Nq=3002026.02 | 20.7 | 0.494 | 0.521 | 0.561 | 32.8 | 16.3 | 16.5 |