Rank Alignment on BigCodeBench Instructions-Only
1Spearman rhoConv-to-Bench
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Conv-to-BenchEvaluator=Gemini-2.5-Flash, Configuration=Instructions-Only2026.04 | 1 | 0.001 | 1 | 0.003 | |
| Arena-Hard-Auto (Code)Evaluator=Gemini-2.5-Flash2026.04 | 0.943 | 0.005 | 0.867 | 0.017 | |
| Conv-to-BenchEvaluator=GPT-5-Mini, Configuration=Instructions-Only2026.04 | 0.886 | 0.019 | 0.733 | 0.056 | |
| Arena-Hard-Auto (Code)Evaluator=GPT-5-Mini2026.04 | 0.829 | 0.042 | 0.733 | 0.056 |