Helpfulness Preference Labeling Accuracy on Ultra-Real
74.8Benchmark ScoreFew-Shot
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Few-ShotJudge=Deepseek-V32026.02 | 74.8 | 57.3 | 17.5 | |
| Few-ShotJudge=Qwen3-14B2026.02 | 74.1 | 56.5 | 17.6 | |
| RandomJudge=Qwen3-14B2026.02 | 73.4 | 57.2 | 16.2 | |
| SeedJudge=Deepseek-V32026.02 | 73.4 | 61.1 | 12.3 | |
| RandomJudge=Deepseek-V32026.02 | 73.4 | 59.7 | 13.7 | |
| Biased Rubric SearchJudge=Qwen3-14B2026.02 | 73.2 | 52.4 | 20.8 | |
| Few-ShotJudge=Gemma-3-27b-it2026.02 | 72.9 | 61 | 11.9 | |
| SeedJudge=Qwen3-14B2026.02 | 72.8 | 61.9 | 10.9 | |
| TextGradJudge=Deepseek-V32026.02 | 72.1 | 53.9 | 18.2 | |
| TextGradJudge=Qwen3-14B2026.02 | 71.9 | 57.9 | 14 | |
| Biased Rubric SearchJudge=Deepseek-V32026.02 | 71.9 | 54.1 | 17.8 | |
| TextGradJudge=Gemma-3-27b-it2026.02 | 71.6 | 62.1 | 9.5 | |
| RandomJudge=Gemma-3-27b-it2026.02 | 71.5 | 64 | 7.5 | |
| SeedJudge=Gemma-3-27b-it2026.02 | 70.2 | 63.5 | 6.7 | |
| Biased Rubric SearchJudge=Gemma-3-27b-it2026.02 | 69.1 | 58.3 | 10.8 |