Cross-lingual Question Answering on MKQA Arabic
24.12fEMCroSearch-R1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CroSearch-R1Backbone=Qwen2.5-7B-Instruct, Paradigm=Post-training2026.04 | 24.12 | 41.63 | |
| SFTBackbone=Qwen2.5-7B-Instruct, Paradigm=Post-training2026.04 | 19.81 | 29.25 | |
| Search-R1Backbone=Qwen2.5-7B-Instruct, Paradigm=Post-training2026.04 | 18.65 | 34.68 | |
| CroSearch-R1Backbone=Qwen2.5-3B-Instruct, Paradigm=Post-training2026.04 | 17.48 | 47.87 | |
| Search-R1Backbone=Qwen2.5-3B-Instruct, Paradigm=Post-training2026.04 | 16.89 | 39.49 | |
| SFTBackbone=Qwen2.5-3B-Instruct, Paradigm=Post-training2026.04 | 16.84 | 28.23 | |
| RAGBackbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 16.37 | 24.43 | |
| IRCoTBackbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 15.28 | 23.84 | |
| Search-o1Backbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 15.16 | 24.53 | |
| Search-o1Backbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 13.67 | 21.81 | |
| IRCoTBackbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 12.46 | 20.61 | |
| RAGBackbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 11.59 | 17.42 | |
| Direct InferenceBackbone=Qwen2.5-7B-Instruct, Paradigm=Training-free2026.04 | 10.73 | 19.69 | |
| Direct InferenceBackbone=Qwen2.5-3B-Instruct, Paradigm=Training-free2026.04 | 7.83 | 17.6 |