PHASE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Phase 2 debugging Overall 13 turns
91F1 Score
12
PHASE
79.21Graph Accuracy
10
PHASE (test)
0.801ADE
10
Phase 10x10 grid 3
48.9Profile Accuracy
7
Phase 2
0.351Spearman's Rho
6
Phase 1
0.607Spearman's rho
6
Phase 2 (test)
15Actual Accuracy
4
Phase 2
0.629Log Loss
3
Phase 1 (trials)
0.565Log Loss
3
Phase f3 synthetic (test)
0.109Test RMSE
2