Response Generation on UltraFeedback (val)
88.1BERTScoreRPO
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RPOModel=Mistral-7B2025.06 | 88.1 | 34.8 | 0.7 | 91 | 108 | — | — | |
| RPOModel=Qwen2.5-7B2025.06 | 88 | 34.6 | 0.7 | 91 | 107 | — | — | |
| RPOModel=LLaMA-3-8B2025.06 | 87.9 | 34.4 | 0.7 | 90 | 106 | — | — | |
| RPOModel=FlanT5-Large2025.06 | 87.1 | 31.6 | 0.9 | 86 | 84 | — | — | |
| RPOModel=FlanT5-XL2025.06 | 87 | 29.7 | 0.8 | 88 | 91 | — | — | |
| DROModel=Mistral-7B2025.06 | 86.9 | 32.6 | 1.1 | 84 | 94 | 88.9 | 86.5 | |
| DROModel=Qwen2.5-7B2025.06 | 86.8 | 32.3 | 1.1 | 84 | 95 | 89.8 | 87.4 | |
| DROModel=LLaMA-3-8B2025.06 | 86.7 | 32 | 1.2 | 83 | 93 | 89.5 | 86.9 | |
| RPOModel=FlanT5-Small2025.06 | 86.6 | 28.9 | 1.2 | 83 | 72 | — | — | |
| KTOModel=Mistral-7B2025.06 | 86.4 | 31.9 | 1.2 | 82 | 91 | 89.8 | 87.3 | |
| KTOModel=Qwen2.5-7B2025.06 | 86.3 | 31.5 | 1.2 | 82 | 89 | 90.7 | 88.2 | |
| KTOModel=LLaMA-3-8B2025.06 | 86.2 | 31.1 | 1.3 | 81 | 88 | 90.2 | 87.9 | |
| SFTModel=Mistral-7B2025.06 | 86.1 | 31.2 | 1.3 | 81 | 88 | 88.6 | 86.2 | |
| SFTModel=Qwen2.5-7B2025.06 | 86 | 30.9 | 1.3 | 80 | 86 | 89.4 | 87.1 | |
| DROModel=FlanT5-Large2025.06 | 85.9 | 30.3 | 1.3 | 79 | 71 | 85.9 | 83.8 | |
| SFTModel=LLaMA-3-8B2025.06 | 85.8 | 30.5 | 1.4 | 80 | 85 | 89.1 | 86.8 | |
| DROModel=FlanT5-Small2025.06 | 85.6 | 25.2 | 1.5 | 76 | 63 | 84.5 | 82.1 | |
| DROModel=FlanT5-XL2025.06 | 85.4 | 25 | 1.2 | 78 | 73 | 85.1 | 83 | |
| SFTModel=FlanT5-XL2025.06 | 85.1 | 24.4 | 1.6 | 74 | 66 | 86.2 | 84.1 | |
| KTOModel=FlanT5-Small2025.06 | 85 | 23.7 | 1.3 | 74 | 59 | 83.1 | 80.8 | |
| SFTModel=FlanT5-Large2025.06 | 84.6 | 24.1 | 1.7 | 73 | 60 | 85.8 | 83.2 | |
| SFTModel=FlanT5-Small2025.06 | 84.2 | 22.8 | 1.8 | 71 | 54 | 81.4 | 79.2 | |
| KTOModel=FlanT5-Large2025.06 | 84 | 24.9 | 2.4 | 75 | 65 | 87 | 84.6 | |
| KTOModel=FlanT5-XL2025.06 | 78.8 | 24.8 | 2.4 | 70 | 57 | 92.7 | 90.1 |