Harmlessness preference labeling accuracy on SafeRLHF-RMB (test)
70.6Bench AccuracyBiased Rubric Search
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Biased Rubric SearchJudge=Qwen3-14B, Refinement=Ours2026.02 | 70.6 | 54.7 | 15.9 | |
| TextGradJudge=Qwen3-14B, Refinement=TextGrad2026.02 | 70.3 | 79.8 | -9.5 | |
| RandomJudge=Deepseek-V3, Refinement=Random2026.02 | 69.8 | 76.8 | 7 | |
| RandomJudge=Qwen3-14B, Refinement=Random2026.02 | 69.7 | 80.2 | -10.5 | |
| TextGradJudge=Deepseek-V3, Refinement=TextGrad2026.02 | 69.5 | 65.3 | 4.2 | |
| Biased Rubric SearchJudge=Deepseek-V3, Refinement=Ours2026.02 | 68.9 | 54.3 | 14.6 | |
| SeedJudge=Qwen3-14B, Refinement=Seed2026.02 | 68.6 | 82.6 | -14 | |
| Biased Rubric SearchJudge=Gemma-3-27b-it, Refinement=Ours2026.02 | 68.2 | 60.5 | 7.7 | |
| Few-ShotJudge=Deepseek-V3, Refinement=Few-Shot2026.02 | 68 | 58.2 | 9.8 | |
| SeedJudge=Deepseek-V3, Refinement=Seed2026.02 | 67.8 | 73.1 | -5.3 | |
| Few-ShotJudge=Qwen3-14B, Refinement=Few-Shot2026.02 | 66.7 | 58.7 | 8 | |
| TextGradJudge=Gemma-3-27b-it, Refinement=TextGrad2026.02 | 65.2 | 66 | -0.8 | |
| RandomJudge=Gemma-3-27b-it, Refinement=Random2026.02 | 63.1 | 77.2 | -14.1 | |
| SeedJudge=Gemma-3-27b-it, Refinement=Seed2026.02 | 59.7 | 82.2 | -22.5 | |
| Few-ShotJudge=Gemma-3-27b-it, Refinement=Few-Shot2026.02 | 57.3 | 55.4 | 1.9 |