List your company
ResearchFormerly WizWand

Natural Language Inference on XNLI Hi (dev)

76.91AccuracySkyline
32.054843.699955.34566.9901Jul 15, 2024Oct 31, 2024Feb 16, 2025Jun 5, 2025Sep 21, 2025Jan 7, 2026Apr 26, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SkylineBackbone=XLMR-large, Input Language=en2026.0476.91
T-top-kEvaluation protocol=translate-train, Supervision type=teacher soft pseudolabels, Data selection strategy=top-k2024.0771.55
Tpl-rand-kselection strategy=rand-k, Zero-shot=true2024.0771.49
Tpl-div-kEvaluation protocol=translate-train, Supervision type=hard prompt labels, Data selection strategy=div-k2024.0771.31
T-div-kEvaluation protocol=translate-train, Supervision type=teacher soft pseudolabels, Data selection strategy=div-k2024.0771.26
T-rand-kEvaluation protocol=translate-train, Supervision type=teacher soft pseudolabels, Data selection strategy=rand-k2024.0771.05
Tpl-rand-kEvaluation protocol=translate-train, Supervision type=hard prompt labels, Data selection strategy=rand-k2024.0771.05
T-top-kselection strategy=top-k, Zero-shot=true2024.0770.82
Tpl-top-kEvaluation protocol=translate-train, Supervision type=hard prompt labels, Data selection strategy=top-k2024.0770.4
T-div-kselection strategy=div-k, Zero-shot=true2024.0770.38
SRC+GENZero-shot=true2024.0770.1
Tpl-top-kselection strategy=top-k, Zero-shot=true2024.0770.02
Tpl-div-kselection strategy=div-k, Zero-shot=true2024.0770
SRC+GENEvaluation protocol=translate-train2024.0769.74
T-rand-kselection strategy=rand-k, Zero-shot=true2024.0768.8
SRCEvaluation protocol=translate-train2024.0767.67
SkylineBackbone=XLMR-large, Input Language=hi2026.0466.12
SRCZero-shot=true2024.0765.54
GENZero-shot=true2024.0762.89
GENEvaluation protocol=translate-train2024.0759.98
XITE-reg-ldaBackbone=XLMR-large, Input Language=en2026.0457.35
XITE-reg-regBackbone=XLMR-large, Input Language=en2026.0455.46
XITE-reg-ldaBackbone=XLMR-large, Input Language=hi2026.0451.02
XITE-reg-regBackbone=XLMR-large, Input Language=hi2026.0442.45
Baseline-PSBackbone=XLMR-large, Input Language=hi2026.0435.31
Baseline-PSBackbone=XLMR-large, Input Language=en2026.0433.78