Natural Language Understanding on GLUE clean (test) (Accuracy & Efficiency)
79RTE AccuracyPABEE
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PABEEBackbone=ALBERT-base2023.10 | 79 | 0.24 | 83 | 0.28 | 87 | 0.32 | 91 | 0.31 | 92 | 0.37 | 93 | 0.37 | 82 | 0.32 | |
| Past-FutureBackbone=ALBERT-base2023.10 | 74 | 0.52 | 86 | 0.5 | 88 | 0.5 | 92 | 0.5 | 92 | 0.52 | — | — | — | — | |
| DeeBERTBackbone=BERT-base2023.10 | 63 | 0.34 | — | — | 82 | 0.35 | 88 | 0.35 | 92 | 0.36 | — | — | 79 | 0.34 |