Test-time routing on 10-cell (failed problem instances)
51.4Rescue RateProblemOracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProblemOracleRouting info=per problem-unit arg max over operators (not deployable), Needs labels=yes, Compute (x retry)=66.52026.06 | 51.4 | 0.142 | |
| DiagnosticOracleRouting info=runs every operator on the test cell, picks modal-best, Needs labels=yes, Compute (x retry)=66.52026.06 | 39 | 0.017 | |
| Outcome-trainedRouting info=RF classifier on the cell’s own per-pid operator outcomes (assay cost = DiagnosticOracle’s), Needs labels=yes, Compute (x retry)=66.52026.06 | 37.4 | 0.001 | |
| Feature-onlyRouting info=winner-take-all over 3 trajectory features; no training, Needs labels=no, Compute (x retry)=1.42026.06 | 37.3 | 0 | |
| RetryRouting info=no information, no test-cell compute beyond resampling, Needs labels=no, Compute (x retry)=1.02026.06 | 37.2 | 0 |