List your company
ResearchFormerly WizWand

Multi-fidelity Multi-armed Bandit on NLI shared evaluation pool

3,277.7Mean Cost-Weighted Pseudo-RegretTACC
3,108.7444,249.1975,389.656,530.103May 8, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TACCHigh-fidelity cost (λ(H))=200, Final budget (Λ)=1280002026.053,277.7
DNCHigh-fidelity cost (λ(H))=200, Final budget (Λ)=1280002026.053,894
TACCHigh-fidelity cost (λ(H))=500, Final budget (Λ)=1280002026.054,023.4
UCBHigh-fidelity cost (λ(H))=200, Final budget (Λ)=1280002026.054,264.1
MF-UCBHigh-fidelity cost (λ(H))=200, Final budget (Λ)=1280002026.054,317
TACCHigh-fidelity cost (λ(H))=1000, Final budget (Λ)=1280002026.054,688.6
UCBHigh-fidelity cost (λ(H))=500, Final budget (Λ)=1280002026.055,083.2
UCBHigh-fidelity cost (λ(H))=1000, Final budget (Λ)=1280002026.055,190.7
DNCHigh-fidelity cost (λ(H))=500, Final budget (Λ)=1280002026.055,201
MF-UCBHigh-fidelity cost (λ(H))=1000, Final budget (Λ)=1280002026.055,334.4
MF-UCBHigh-fidelity cost (λ(H))=500, Final budget (Λ)=1280002026.055,359.1
DNCHigh-fidelity cost (λ(H))=1000, Final budget (Λ)=1280002026.055,532.7
Low-ImprovingHigh-fidelity cost (λ(H))=1000, Final budget (Λ)=1280002026.056,668.6
Low-ImprovingHigh-fidelity cost (λ(H))=500, Final budget (Λ)=1280002026.056,808.4
Low-ImprovingHigh-fidelity cost (λ(H))=200, Final budget (Λ)=1280002026.056,827.5
Weak-FixedHigh-fidelity cost (λ(H))=1000, Final budget (Λ)=1280002026.057,058.4
Weak-FixedHigh-fidelity cost (λ(H))=200, Final budget (Λ)=1280002026.057,331.9
Weak-FixedHigh-fidelity cost (λ(H))=500, Final budget (Λ)=1280002026.057,501.6