Natural Language Understanding on GLUE (CoLA, STS-B, RTE Subset)
47.49CoLA MCCGLOT (BERT)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GLOT (BERT)Runtime (ms)=13.40 ± 3.00, Params (M)=8.922026.03 | 47.49 | 83.86 | 59.21 | |
| SimCSE (BERT-sup)Runtime (ms)=47.21 ± 0.09, Params (M)=109.502026.03 | 24.91 | 87.27 | 52.7 | |
| SBERT (MPNet-v2)Runtime (ms)=52.99 ± 0.08, Params (M)=109.502026.03 | 17.7 | 86.7 | 54.51 |