Natural Language Understanding on GLUE (CoLA, SST-2, MRPC, QQP, MNLI-M, MNLI-MM, QNLI)
12.4CoLA ScoreTF (Sin.)
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| TF (Sin.)Architecture=TF (Sin.)2026.05 | 12.4 | 81.1 | 59.1 | 67.5 | 70.7 | 75.8 | 49 | 50.5 | 56.9 | |
| TF (NoPE)Architecture=TF (NoPE)2026.05 | 9.7 | 79.1 | 59 | 64 | 72.8 | 77.8 | 50.5 | 51.1 | 58.8 | |
| TF (ALiBi)Architecture=TF (ALiBi)2026.05 | 9.6 | 79.3 | 56.2 | 62.6 | 74 | 78.3 | 53.9 | 52.8 | 58.1 | |
| MLP-LDRUArchitecture=MLP-LDRU2026.05 | 8.5 | 80.9 | 57 | 63.2 | 76.9 | 79.1 | 58.3 | 57.9 | 56.1 |