Bilingual Response Generation on English en
54.1QA-F1HDPO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HDPOModel=Gemma-2-2B2026.06 | 54.1 | 0.275 | 78.8 | 85.3 | 73.1 | |
| Bucket-SFTModel=Qwen2.5-3B2026.06 | 47.6 | 0.25 | 90.3 | 65.2 | 68.8 | |
| HDPOModel=Qwen2.5-1.5B2026.06 | 46.3 | 0.465 | 84.6 | 62.3 | 63.9 | |
| Bucket-SFTModel=Qwen2.5-1.5B2026.06 | 44.4 | 0.427 | 93.9 | 58.5 | 64.3 | |
| HDPOModel=Qwen2.5-3B2026.06 | 41.8 | 0.49 | 77.9 | 47.4 | 56.7 | |
| HDPOModel=Llama-3.2-3B2026.06 | 40.5 | 0.36 | 75 | 60 | 60.4 | |
| Full-SFTModel=Qwen2.5-3B2026.06 | 39.8 | 649.49 | 91.8 | 64.4 | 13.7 | |
| Bucket-SFTModel=Gemma-2-2B2026.06 | 38.7 | 0.383 | 87.1 | 51.6 | 59.5 | |
| Bucket-SFTModel=Llama-3.2-3B2026.06 | 37.2 | 0.373 | 86.7 | 43.9 | 56.6 | |
| DPOModel=Llama-3.2-3B2026.06 | 35.6 | 24.431 | 78.6 | 63.2 | 28.8 | |
| DPOModel=Qwen2.5-1.5B2026.06 | 35.5 | 1.259 | 84.7 | 58 | 52.7 | |
| Full-SFTModel=Llama-3.2-3B2026.06 | 34.4 | 1.139 | 90.6 | 62.7 | 55 | |
| Full-SFTModel=Qwen2.5-1.5B2026.06 | 31.7 | 5.012 | 94.7 | 54.7 | 37.1 | |
| DPOModel=Gemma-2-2B2026.06 | 31 | 28,526 | 87.4 | 36.5 | 4.3 | |
| Full-SFTModel=Gemma-2-2B2026.06 | 30.8 | 411.77 | 91.1 | 53.4 | 13.8 | |
| DPOModel=Qwen2.5-3B2026.06 | 26.7 | 4.014 | 75.7 | 52.3 | 38.1 | |
| BaseLMModel=Qwen2.5-1.5B2026.06 | 24.8 | 6.344 | 53.1 | 17 | 23.5 | |
| BaseLMModel=Llama-3.2-3B2026.06 | 22.7 | 9.773 | 80.8 | 35.2 | 27.8 | |
| BaseLMModel=Qwen2.5-3B2026.06 | 20 | 4.847 | 55.8 | 30.9 | 27.7 | |
| BaseLMModel=Gemma-2-2B2026.06 | 19.4 | 7,708.6 | 78.4 | 27 | 4.8 | |
| CoTModel=Qwen2.5-3B2026.06 | 10.1 | 2.291 | 22.8 | 21.3 | 19.7 | |
| CoTModel=Llama-3.2-3B2026.06 | 10 | 2.43 | 31.5 | 18.6 | 20.3 | |
| CoTModel=Qwen2.5-1.5B2026.06 | 9.9 | 2.592 | 30.7 | 22.2 | 20.8 | |
| CoTModel=Gemma-2-2B2026.06 | 5.7 | 4.876 | 13.5 | 6.6 | 9.6 |