Entity Translation on XC-Translate (test)
35.03Accuracy (AR)GPT-5-mini
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-5-miniBase Model=GPT-5-mini, Optimization Strategy=None2026.04 | 35.03 | 36.03 | 42.71 | 35.85 | 35.37 | 37.27 | 30.2 | 15.96 | 40.44 | 29.85 | 33.87 | 62.3 | |
| Qwen3-14B + EA-RLVRBase Model=Qwen3-14B, Optimization Strategy=EA-RLVR2026.04 | 28.17 | 33.71 | 44.7 | 35.1 | 37.62 | 27.64 | 31.29 | 17.09 | 29.96 | 33.42 | 31.87 | 62.27 | |
| Qwen3-235B-A22BBase Model=Qwen3-235B-A22B, Optimization Strategy=None2026.04 | 27.93 | 32.06 | 41.79 | 34.29 | 33.07 | 29.07 | 30.22 | 15.32 | 34.32 | 32.38 | 31.05 | 61.99 | |
| Qwen3-8B + EA-RLVRBase Model=Qwen3-8B, Optimization Strategy=EA-RLVR2026.04 | 25.23 | 31.01 | 44.44 | 34.89 | 35.35 | 24.02 | 25.7 | 14.74 | 27.79 | 29.31 | 29.25 | 59.86 | |
| Qwen3-14BBase Model=Qwen3-14B, Optimization Strategy=None2026.04 | 20.48 | 26.86 | 34.88 | 28.66 | 28.7 | 18.81 | 17.67 | 7.98 | 25.96 | 26.57 | 23.66 | 58.22 | |
| Qwen3-14B + SFTBase Model=Qwen3-14B, Optimization Strategy=SFT2026.04 | 20.21 | 26.97 | 35.13 | 28.75 | 30.05 | 18.32 | 17.65 | 8.01 | 25.93 | 27.75 | 23.88 | 59.43 | |
| Qwen3-8B + SFTBase Model=Qwen3-8B, Optimization Strategy=SFT2026.04 | 15.28 | 23.28 | 30.76 | 25.32 | 25.44 | 16.86 | 11.12 | 5.86 | 23.56 | 23.08 | 20.06 | 56.2 | |
| Qwen3-8BBase Model=Qwen3-8B, Optimization Strategy=None2026.04 | 14.91 | 23.64 | 31.04 | 25.97 | 25.01 | 17.13 | 11.12 | 5.63 | 23.94 | 23.5 | 20.19 | 56.07 | |
| Marco-o1Base Model=Marco-o1, Optimization Strategy=None2026.04 | 11.88 | 19.72 | 26.47 | 22.09 | 21.26 | 11.77 | 8.42 | 3.45 | 17.71 | 16.23 | 15.9 | 49.68 | |
| DeepTrans-7BBase Model=DeepTrans-7B, Optimization Strategy=None2026.04 | 11.41 | 21.58 | 30.1 | 23.49 | 22.44 | 13.21 | 8.44 | 2.9 | 17.37 | 15.96 | 16.69 | 47.88 |