Simulation Accuracy on Helpfulness (val)
56.8AccuracyJ+RR
Evaluation results
| Method | Links | |
|---|---|---|
| J+RRModel=Claude-3.7-Sonnet, Demonstration Count=2-Shot2026.07 | 56.8 | |
| J+RRModel=Claude-3.5-Sonnet, Demonstration Count=8-Shot2026.07 | 55.8 | |
| J+RRModel=Claude-3.7-Sonnet, Demonstration Count=8-Shot2026.07 | 55.8 | |
| J+RRModel=Claude-3.7-Sonnet, Demonstration Count=4-Shot2026.07 | 55.7 | |
| J+RRModel=Claude-3.5-Sonnet, Demonstration Count=4-Shot2026.07 | 54.8 | |
| J+RRModel=Claude-3.5-Sonnet, Demonstration Count=2-Shot2026.07 | 54.4 | |
| Base JudgeModel=Claude-3.7-Sonnet2026.07 | 50.6 | |
| Base JudgeModel=Claude-3.5-Sonnet2026.07 | 50 |