Multi-hop Reasoning on TAT-QA
81F1 ScoreOCC-RAG-1.7B
Evaluation results
| Method | Links | |
|---|---|---|
| OCC-RAG-1.7Bthinking mode=false2026.05 | 81 | |
| Qwen3-4Bthinking mode=true2026.05 | 79.1 | |
| Qwen3-4Bthinking mode=false2026.05 | 76.9 | |
| Qwen3-32Bthinking mode=true2026.05 | 76.7 | |
| gemma-3-12b-itthinking mode=false2026.05 | 76.5 | |
| Qwen3-32Bthinking mode=false2026.05 | 75.9 | |
| gemma-3-27b-itthinking mode=false2026.05 | 75.4 | |
| OCC-RAG-0.6Bthinking mode=false2026.05 | 75 | |
| Qwen3-1.7Bthinking mode=true2026.05 | 74.8 | |
| Qwen3-8Bthinking mode=true2026.05 | 74.5 | |
| Qwen3-1.7Bthinking mode=false2026.05 | 74.4 | |
| Qwen3-14Bthinking mode=true2026.05 | 74 | |
| Qwen3-8Bthinking mode=false2026.05 | 72.9 | |
| SmolLM3-3Bthinking mode=false2026.05 | 71.1 | |
| Qwen3-14Bthinking mode=false2026.05 | 70 | |
| SmolLM3-3Bthinking mode=true2026.05 | 69.7 | |
| Qwen3-0.6Bthinking mode=true2026.05 | 66.3 | |
| gemma-3-4b-itthinking mode=false2026.05 | 65.3 | |
| Qwen3-0.6Bthinking mode=false2026.05 | 62.5 | |
| gemma-3-1b-itthinking mode=false2026.05 | 53.6 | |
| Pleias-RAG-1.2Bthinking mode=false2026.05 | 8.4 |