Generation Quality Evaluation on AlpacaFarm
36.4Win RateUMM-RM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| UMM-RMexperts=6, opponent=Dense RM2025.11 | 36.4 | 40.3 | 23.3 | |
| UMM-RMexperts=2, opponent=SFT Model2025.11 | 36.4 | 27.3 | 36.3 | |
| UMM-RMexperts=6, opponent=SFT Model2025.11 | 32.3 | 39.9 | 27.8 | |
| UMM-RMexperts=4, opponent=SFT Model2025.11 | 32.2 | 37.5 | 30.3 | |
| UMM-RMexperts=4, opponent=Dense RM2025.11 | 30.6 | 45.5 | 23.9 | |
| UMM-RMexperts=2, opponent=Dense RM2025.11 | 28.9 | 43 | 28.1 | |
| UMM-RMexperts=6, opponent=Worst-Case Optimization (4-RMs)2025.11 | 28.3 | 60.2 | 11.5 | |
| UMM-RMexperts=4, opponent=Worst-Case Optimization (4-RMs)2025.11 | 27 | 63.4 | 9.7 | |
| UMM-RMexperts=6, opponent=Uncertainty-Weighted Optimization (4-RMs)2025.11 | 23.9 | 62.4 | 13.7 | |
| UMM-RMexperts=6, opponent=Mean Optimization (4-RMs)2025.11 | 22 | 60.4 | 17.6 | |
| UMM-RMexperts=4, opponent=Uncertainty-Weighted Optimization (4-RMs)2025.11 | 16.5 | 73.9 | 9.6 | |
| UMM-RMexperts=4, opponent=Mean Optimization (4-RMs)2025.11 | 11.8 | 71.1 | 17.1 |