Natural Language Understanding on SuperGLUE (CB, COPA, BoolQ, WiC subset)
94.5CB AccuracyARMADA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ARMADAModels=DeBERTa-v2-xxlarge, Loss=Lcosine, Teacher=Midjourney2026.03 | 94.5 | 81.9 | 87.3 | 57.6 | |
| ARMADAModels=DeBERTa-v2-xxlarge, Loss=Leuclid, Teacher=Midjourney2026.03 | 93.4 | 79.9 | 87.9 | 60 | |
| ARMADAModel=DeBERTa-v2-xxlarge, Distillation type=ARMADA - Lelementwise2026.03 | 93 | 79.9 | 87.8 | 59.9 | |
| ARMADAModels=DeBERTa-v2-xxlarge, Loss=Lelementwise, Teacher=Midjourney2026.03 | 92.8 | 81.9 | 88.1 | 59.6 | |
| ARMADAModel=DeBERTa-v2-xxlarge, Distillation type=ARMADA - Lcosine2026.03 | 92.8 | 81.9 | 86.2 | 59.2 | |
| ARMADAModel=DeBERTa-v2-xxlarge, Distillation type=ARMADA - Leuclid2026.03 | 92.8 | 78.9 | 87.7 | 58.2 | |
| ARMADAModels=BERT-base, Loss=Leuclid, Teacher=Midjourney2026.03 | 87.4 | 62.9 | 72.3 | 58.2 | |
| ARMADAModel=BERT-base, Distillation type=ARMADA - Lelementwise2026.03 | 87.4 | 68 | 75.3 | 58.4 | |
| ARMADAModel=BERT-base, Distillation type=ARMADA - Lcosine2026.03 | 85.7 | 67.7 | 75.8 | 58.5 | |
| ARMADAModel=BERT-base, Distillation type=ARMADA - Leuclid2026.03 | 85.7 | 67.9 | 75.1 | 58.8 | |
| ARMADAModels=BERT-base, Loss=Lcosine, Teacher=Midjourney2026.03 | 85.6 | 64.9 | 73.3 | 56.2 | |
| ARMADAModels=BERT-base, Loss=Lelementwise, Teacher=Midjourney2026.03 | 83.8 | 60.9 | 73 | 58.7 | |
| BERT-baseDistillation type=undistilled2026.03 | 83.7 | 62.9 | 75.1 | 58.4 | |
| undistilledModel=BERT-base, Distillation type=undistilled2026.03 | 83.7 | 62.9 | 75.1 | 58.4 | |
| DeBERTa-v2-xxlargeDistillation type=undistilled2026.03 | 81.9 | 83.7 | 87.2 | 60.8 | |
| undistilledModel=DeBERTa-v2-xxlarge, Distillation type=undistilled2026.03 | 81.9 | 83.7 | 87.2 | 60.8 | |
| ARMADAModels=OPT-1.3B, Loss=Lcosine, Teacher=Midjourney2026.03 | 80.2 | 54.9 | 75.3 | 55.9 | |
| ARMADAModel=BERT-6L, Distillation type=ARMADA - Lelementwise2026.03 | 78.6 | 63 | 73 | 57.9 | |
| ARMADAModels=OPT-1.3B, Loss=Leuclid, Teacher=Midjourney2026.03 | 78.5 | 58.9 | 75.6 | 57 | |
| ARMADAModel=BERT-6L, Distillation type=ARMADA - Leuclid2026.03 | 78.5 | 63 | 73.1 | 58.1 | |
| ARMADAModel=OPT-1.3B, Distillation type=ARMADA - Lcosine2026.03 | 78.5 | 57.9 | 77.3 | 56.7 | |
| ARMADAModels=BERT-6L, Loss=Lelementwise, Teacher=Midjourney2026.03 | 78.4 | 51.9 | 73.3 | 55.9 | |
| OPT-1.3BDistillation type=undistilled2026.03 | 78.2 | 54.8 | 74.6 | 57.9 | |
| undistilledModel=OPT-1.3B, Distillation type=undistilled2026.03 | 78.2 | 54.8 | 74.6 | 57.9 | |
| ARMADAModel=BERT-6L, Distillation type=ARMADA - Lcosine2026.03 | 76.8 | 62.8 | 73.1 | 57.8 | |
| ARMADAModel=OPT-1.3B, Distillation type=ARMADA - Leuclid2026.03 | 76.7 | 57 | 76 | 57 | |
| ARMADAModel=OPT-1.3B, Distillation type=ARMADA - Lelementwise2026.03 | 76.7 | 58.9 | 76.1 | 56.1 | |
| ARMADAModels=OPT-1.3B, Loss=Lelementwise, Teacher=Midjourney2026.03 | 76.6 | 58.9 | 76 | 57 | |
| BERT-6LDistillation type=undistilled2026.03 | 75 | 53 | 71.3 | 55.7 | |
| ARMADAModels=BERT-6L, Loss=Leuclid, Teacher=Midjourney2026.03 | 75 | 62.9 | 72.4 | 58.2 | |
| undistilledModel=BERT-6L, Distillation type=undistilled2026.03 | 75 | 53 | 71.3 | 55.7 | |
| ARMADAModels=BERT-6L, Loss=Lcosine, Teacher=Midjourney2026.03 | 73.1 | 49.9 | 71.8 | 56.6 |