Natural Language Understanding on GLUE & SuperGLUE (test dev)
89.8STS-B ScorePEMT
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PEMTk-shot=162024.02 | 89.8 | 86.8 | 69.8 | 43.4 | 72.4 | 74 | 66.5 | 44.2 | 82.1 | 69.9 | |
| PEMTk-shot=322024.02 | 89.8 | 86.3 | 71.9 | 45.5 | 72.2 | 74.4 | 61.8 | 51.9 | 85.7 | 71.1 | |
| MPTk-shot=322024.02 | 89.7 | 74.5 | 59.7 | 30.8 | 63.3 | 68.9 | 53.9 | 67.3 | 82.1 | 65.6 | |
| PEMTk-shot=42024.02 | 89.2 | 78.4 | 64 | 44.7 | 72 | 71 | 62.1 | 44.2 | 78.6 | 67.1 | |
| MPTk-shot=42024.02 | 89.1 | 68.1 | 62.6 | 34.8 | 62.2 | 62.2 | 52.9 | 67.3 | 73.6 | 63.6 | |
| MPTk-shot=162024.02 | 89.1 | 70.1 | 64.8 | 32.1 | 64.5 | 63.3 | 49.8 | 67.3 | 78.6 | 64.4 | |
| PTk-shot=42024.02 | 88.8 | 68.1 | 56.3 | 27.4 | 61.8 | 61.6 | 51.2 | 60.4 | 53.5 | 58.8 | |
| PTk-shot=162024.02 | 87.8 | 68.1 | 54.7 | 28.5 | 60.3 | 61.9 | 48.9 | 44.2 | 63.5 | 57.5 | |
| PTk-shot=322024.02 | 87.5 | 68.1 | 54.7 | 23.2 | 59.2 | 61.7 | 52.6 | 67.3 | 67.8 | 60.2 |