Budgeted Hybrid Routing on Medical En→Zh
100HitRate@pGain Oracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gain OracleType=Oracle, Route=top-p, Budget (p)=0.32026.04 | 100 | 12.55 | |
| Quality OracleType=Oracle, Route=top-p, Budget (p)=0.32026.04 | 69.36 | 9.88 | |
| RouteLMTType=Learned, Form=In-model, Target=Δ, Score=g_hat(x; d), Route=top-p, Extra model=No, Budget (p)=0.32026.04 | 47.66 | 5.81 | |
| RouteLMT-QType=Learned, Form=In-model, Target=Q, Score=q_hat_s(x; d), Route=bottom-p, Extra model=No, Budget (p)=0.32026.04 | 46.52 | 5.84 | |
| sentinel-src-25Type=Learned, Form=External, Target=Q, Score=q_hat_s(x; d), Route=bottom-p, Extra model=Yes, Budget (p)=0.32026.04 | 43.4 | 5.07 | |
| sentinel-src-24Type=Learned, Form=External, Target=Q, Score=q_hat_s(x; d), Route=bottom-p, Extra model=Yes, Budget (p)=0.32026.04 | 42.55 | 4.99 | |
| XLM-R-ΔType=Learned, Form=External, Target=Δ, Score=g_hat(x; d), Route=top-p, Extra model=Yes, Budget (p)=0.32026.04 | 40.28 | 4.79 | |
| XLM-R-QType=Learned, Form=External, Target=Q, Score=q_hat_s(x; d), Route=bottom-p, Extra model=Yes, Budget (p)=0.32026.04 | 39.72 | 4.81 | |
| LengthType=Heuristic, Score=length, Route=top-p, Extra model=No, Budget (p)=0.32026.04 | 39.29 | 4.36 | |
| EntropyType=Heuristic, Score=entropy, Route=top-p, Extra model=No, Budget (p)=0.32026.04 | 33.62 | 3.69 | |
| RarityType=Heuristic, Score=surprisal, Route=top-p, Extra model=No, Budget (p)=0.32026.04 | 32.2 | 3.3 | |
| RandomType=Baseline, Score=uniform, Route=top-p, Extra model=No, Budget (p)=0.32026.04 | 30 | 3 |