Blind pairwise comparison on AutoControl Arena vs Petri Pairwise Comparison Set (N=40) (test)
0.625Win Rate (Ours)AUTOCONTROL ARENA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AUTOCONTROL ARENADimension=State Consistency2026.03 | 0.625 | 0.1 | 0.275 | |
| AUTOCONTROL ARENADimension=Overall Preference2026.03 | 0.6 | 0.1 | 0.3 | |
| AUTOCONTROL ARENADimension=Scenario Coherence2026.03 | 0.575 | 0.1 | 0.325 | |
| AUTOCONTROL ARENADimension=Tool Behavior Fidelity2026.03 | 0.525 | 0.1 | 0.375 |