Meta-evaluation of Trajectory Evaluation Metrics on SGRL Benchmarks Aggregate
95.8Oracle Rank Accuracy (Acc)Interval-Paired Preference (IPP)
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Interval-Paired Preference (IPP)2026.06 | 95.8 | 37.7 | 62.5 | 78 | 81 | 2.83 | 35.09 | 53.34 | 73.76 | 0 | 0 | |
| Lexicographic Return (LR)2026.06 | 95.6 | 37.5 | 61.6 | 83 | 85 | 0 | 33.9 | 66.16 | 77.81 | 0 | 0 | |
| Return-Paired Preference (RPP)2026.06 | 94.2 | 37.5 | 63.2 | 83 | 85 | 1.88 | 34.82 | 61.51 | 78.35 | 0 | 0 | |
| Success weighted by Path Length (SPL)2026.06 | 91.8 | 31.6 | 48.1 | 71 | 70 | 5.5 | 63.42 | 39.02 | 60.2 | 0 | 0 | |
| Success Rate (SR)2026.06 | 12.8 | 0 | 0 | 75 | 73 | 0 | 74.9 | 44.98 | 58.47 | 0 | 0 | |
| Path Reward (PR)2026.06 | 12.8 | 0 | 0 | 82 | 82 | 2.14 | 49.71 | 56.53 | 73.37 | 0 | 0 |