Explicit-Implicit Reasoning on MixRea
76.5IIAGemini 2.5 Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini 2.5 ProAlignment=chat or instruct2026.05 | 76.5 | 91.4 | 9.4 | |
| LLaMA 3.1-405BAlignment=chat or instruct2026.05 | 71.1 | 91.1 | 12.4 | |
| Deepseek-R1Alignment=chat or instruct2026.05 | 70.9 | 92.4 | 9.5 | |
| Claude 3.7 SonnetAlignment=chat or instruct2026.05 | 70.1 | 92.1 | 12.7 | |
| LLaMA 3.1-70BAlignment=chat or instruct2026.05 | 67.6 | 90.5 | 13.6 | |
| Gemini 2.5 FlashAlignment=chat or instruct2026.05 | 67.1 | 92.5 | 15.1 | |
| GPT-4oAlignment=chat or instruct2026.05 | 66.6 | 91.5 | 13.2 | |
| Qwen 2.5-32BAlignment=chat or instruct2026.05 | 66.4 | 91.7 | 14.6 | |
| Deepseek-V3Alignment=chat or instruct2026.05 | 65.4 | 92.5 | 14 | |
| LLaMA 3-70BAlignment=chat or instruct2026.05 | 65.4 | 90.3 | 14.6 | |
| Gemma 3-27BAlignment=chat or instruct2026.05 | 65.2 | 87.6 | 16.2 | |
| Gemma 2-27BAlignment=chat or instruct2026.05 | 65.1 | 87.2 | 14.3 | |
| Qwen-MaxAlignment=chat or instruct2026.05 | 65 | 91.6 | 15.4 | |
| Qwen 2-7BAlignment=chat or instruct2026.05 | 64.2 | 85.1 | 14.3 | |
| Qwen 2.5-72BAlignment=chat or instruct2026.05 | 63.9 | 87.9 | 16 | |
| Qwen 2.5-7BAlignment=chat or instruct2026.05 | 62.6 | 84.1 | 15 | |
| Gemma 3-12BAlignment=chat or instruct2026.05 | 61.8 | 86.6 | 18.2 | |
| Qwen 2-72BAlignment=chat or instruct2026.05 | 61.3 | 91.6 | 17.7 | |
| GPT-4o-miniAlignment=chat or instruct2026.05 | 57.5 | 86.6 | 20.3 | |
| LLaMA 3-8BAlignment=chat or instruct2026.05 | 57.5 | 81.7 | 18.3 | |
| LLaMA 3.1-8BAlignment=chat or instruct2026.05 | 54.9 | 83.3 | 20.3 |