OOD Detection on ndd2015 (OOD) WMT15 En-Fr (ID) (test)
92.32AUROCAP-OOD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AP-OODOOD level=Input, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 92.32 | 49.03 | |
| AP-OODOOD level=Output, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 91.49 | 51.87 | |
| Deep SADOOD level=Input, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 91.11 | 57.4 | |
| Binary logitsOOD level=Input, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 90.59 | 57.18 | |
| Binary logitsOOD level=Output, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 89.98 | 56.02 | |
| Relative MahalanobisOOD level=Input, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 88.62 | 67.87 | |
| Relative MahalanobisOOD level=Output, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 88.35 | 69.29 | |
| AP-OODBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Output, Unsupervised=true2026.02 | 75.65 | 80.44 | |
| EntropyBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Output, Unsupervised=true2026.02 | 73.78 | 76.64 | |
| PerplexityBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Output, Unsupervised=true2026.02 | 72.8 | 85.05 | |
| AP-OODBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Input, Unsupervised=true2026.02 | 67.64 | 87.85 | |
| KNNBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Output, Unsupervised=true2026.02 | 65.78 | 92.91 | |
| Deep SADOOD level=Output, Learning paradigm=Supervised, Backbone=Transformer (base)2026.02 | 64.46 | 93.97 | |
| KNNBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Input, Unsupervised=true2026.02 | 63.66 | 91.33 | |
| MahalanobisBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Output, Unsupervised=true2026.02 | 62.76 | 92.87 | |
| MahalanobisBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Input, Unsupervised=true2026.02 | 62.02 | 91.67 | |
| Deep SVDDBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Output, Unsupervised=true2026.02 | 60.39 | 94.73 | |
| Deep SVDDBackbone=Transformer (base), Training Data=WMT15 En-Fr, Evaluation Side=Input, Unsupervised=true2026.02 | 59.59 | 93.77 |