ResearchBenchmarksDeferral-advice on CLIP prompt-escalation (val)Deferral-advice on CLIP prompt-escalation (val)Follow0.337True Deferral-Advice LossAugmented Policy0.317320.450160.5830.71584Mar 15, 2026Evaluation resultsMethodMethodLinksTrue Deferral-Advice LossAugmented Policyλ=0λ=02026.030.337Learned expert, random adviceλ=0λ=02026.030.343Augmented Policyλ=0.1λ=0.12026.030.345Learned expert, random adviceλ=0.1λ=0.12026.030.348Augmented Policyλ=0.15λ=0.152026.030.348Learned expert, random adviceλ=0.15λ=0.152026.030.35Augmented Policyλ=0.3λ=0.32026.030.35Augmented Policyλ=0.4λ=0.42026.030.35Augmented Policyλ=0.6λ=0.62026.030.35Augmented Policyλ=0.7λ=0.72026.030.35Best fixed pairλ=0λ=02026.030.351Augmented Policyλ=0.8λ=0.82026.030.351Augmented Policyλ=1λ=12026.030.351Augmented Policyλ=1.5λ=1.52026.030.351L2Dλ=0λ=02026.030.352L2Dλ=0.1λ=0.12026.030.352L2Dλ=0.15λ=0.152026.030.352L2Dλ=0.3λ=0.32026.030.352L2Dλ=0.4λ=0.42026.030.352L2Dλ=0.6λ=0.62026.030.352L2Dλ=0.7λ=0.72026.030.352L2Dλ=0.8λ=0.82026.030.352L2Dλ=1λ=12026.030.352L2Dλ=1.5λ=1.52026.030.352Augmented Policyλ=10λ=102026.030.352L2Dλ=10λ=102026.030.352Learned expert, random adviceλ=0.3λ=0.32026.030.357Best fixed pairλ=0.1λ=0.12026.030.359Best fixed pairλ=0.15λ=0.152026.030.361Learned expert, random adviceλ=0.4λ=0.42026.030.361Best fixed pairλ=0.3λ=0.32026.030.365Best fixed pairλ=0.4λ=0.42026.030.366Best fixed pairλ=0.6λ=0.62026.030.366Best fixed pairλ=0.7λ=0.72026.030.366Best fixed pairλ=0.8λ=0.82026.030.366Best fixed pairλ=1λ=12026.030.366Best fixed pairλ=1.5λ=1.52026.030.366Best fixed pairλ=10λ=102026.030.366Learned expert, random adviceλ=0.6λ=0.62026.030.37Random expert, learned adviceλ=0λ=02026.030.374Learned expert, random adviceλ=0.7λ=0.72026.030.374Random (j, k)λ=0λ=02026.030.379Learned expert, random adviceλ=0.8λ=0.82026.030.379Random expert, learned adviceλ=0.1λ=0.12026.030.381Random (j, k)λ=0.1λ=0.12026.030.383Random expert, learned adviceλ=0.15λ=0.152026.030.384Random (j, k)λ=0.15λ=0.152026.030.386Random expert, learned adviceλ=0.3λ=0.32026.030.387Random expert, learned adviceλ=0.4λ=0.42026.030.388Random expert, learned adviceλ=0.6λ=0.62026.030.388Random expert, learned adviceλ=0.7λ=0.72026.030.388Random expert, learned adviceλ=0.8λ=0.82026.030.388Learned expert, random adviceλ=1λ=12026.030.388Random expert, learned adviceλ=1λ=12026.030.388Random expert, learned adviceλ=1.5λ=1.52026.030.388Random expert, learned adviceλ=10λ=102026.030.388Random (j, k)λ=0.3λ=0.32026.030.392Random (j, k)λ=0.4λ=0.42026.030.397Random (j, k)λ=0.6λ=0.62026.030.406Random (j, k)λ=0.7λ=0.72026.030.41Learned expert, random adviceλ=1.5λ=1.52026.030.41Random (j, k)λ=0.8λ=0.82026.030.415Random (j, k)λ=1λ=12026.030.424Random (j, k)λ=1.5λ=1.52026.030.446Learned expert, random adviceλ=10λ=102026.030.795Random (j, k)λ=10λ=102026.030.829