Multilingual Logical Reasoning on CrossMMLU
84.7Accuracy (English)Qwen2.5-7B-AdaMCOT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-7B-AdaMCOTBackbone=Qwen2.5-7B2025.01 | 84.7 | 82.7 | 77.3 | 91.3 | |
| LLaMA3.1-8B-AdaMCOTBackbone=LLaMA3.1-8B2025.01 | 84 | 74 | 69.3 | 82.7 | |
| Qwen2.5-7B-InstructionBackbone=Qwen2.5-7B2025.01 | 84 | 80.7 | 74.7 | 73.3 | |
| LLaMA3.1-8B-InstructionBackbone=LLaMA3.1-8B2025.01 | 82 | 68 | 67.3 | 66.7 |