Scientific Reasoning on GPQA (test) (Multilingual Recovery Metrics)
26.6ARQwen2.5-7B Instruct
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2.5-7B InstructSetting=Multi-lingual LLM Baseline2026.01 | 26.6 | 20.5 | 26.1 | 27.5 | 26.8 | 21.4 | 21.4 | 28.4 | 30.6 | 25.5 | |
| ACTSetting=With supervised fine-tuning, SFT=true2026.01 | 22.1 | 18.1 | 20.3 | 19 | 22.3 | 11.6 | 21.4 | 19.9 | 18.3 | 19.2 | |
| Task ArithmeticSetting=With supervised fine-tuning, SFT=true2026.01 | 21.2 | 15.4 | 18.3 | 17.4 | 20.8 | 10 | 13.4 | 19.4 | 17.9 | 17.1 | |
| DARE MergingSetting=With supervised fine-tuning, SFT=true2026.01 | 20.8 | 13 | 18.1 | 19.2 | 20.8 | 10.7 | 13.4 | 19.4 | 21.6 | 17.4 | |
| TIES MergingSetting=With supervised fine-tuning, SFT=true2026.01 | 20.1 | 11.2 | 17.4 | 16.1 | 17.9 | 10.5 | 13 | 18.5 | 16.5 | 15.7 | |
| SFTSetting=With supervised fine-tuning, SFT=true2026.01 | 18.3 | 12.1 | 19 | 21.2 | 19.4 | 8 | 11.4 | 21.9 | 19.2 | 16.7 | |
| Task ArithmeticSetting=Ability Transfer, SFT=false2026.01 | 16.5 | 4.2 | 17 | 16.3 | 13.2 | 13.8 | 12.5 | 13.2 | 13.6 | 13.4 | |
| ACTSetting=Ability Transfer (transfer-only), SFT=false2026.01 | 15.4 | 13.6 | 13.6 | 17.6 | 19 | 17.6 | 17.4 | 15 | 15 | 16 | |
| DARE MergingSetting=Ability Transfer, SFT=false2026.01 | 15.2 | 7.1 | 13.2 | 13.8 | 13.8 | 13.8 | 13.4 | 13 | 15.2 | 13.2 | |
| Qwen2.5-7B Math InstructSetting=Multi-lingual LLM Baseline2026.01 | 14.3 | 9.6 | 13 | 11.6 | 11.8 | 15.4 | 11.8 | 12.3 | 11.2 | 12.3 | |
| TIES MergingSetting=Ability Transfer, SFT=false2026.01 | 11.8 | 8 | 14.5 | 14.1 | 12.5 | 16.3 | 11.2 | 15.6 | 12.7 | 13 |