Natural Language Understanding on WG, Yelp, SciTail, and PAWS Aggregate
62.3WG AccuracyPEMT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PEMT2024.02 | 62.3 | 97 | 96.9 | 94.3 | 87.6 | |
| FT2024.02 | 61.9 | 96.7 | 95.8 | 94.1 | 87.1 | |
| LoRA2024.02 | 60.2 | 96.4 | 94.5 | 94.2 | 86.3 | |
| Adamix2024.02 | 59.8 | 96.6 | 96 | 94 | 86.6 | |
| Adapter2024.02 | 59.2 | 96.9 | 94.5 | 94.3 | 86.2 | |
| ATTEMPT2024.02 | 57.6 | 96.7 | 93.1 | 92.1 | 84.9 | |
| BitFit2024.02 | 57.2 | 94.7 | 94.7 | 92 | 84.7 | |
| MPT2024.02 | 56.5 | 96.4 | 95.5 | 93.5 | 85.5 | |
| MixDA2024.02 | 55.2 | 95.7 | 50.8 | 82.7 | 71.1 | |
| SPoT2024.02 | 50.4 | 95.4 | 91.2 | 91.1 | 82 | |
| PT2024.02 | 49.6 | 95.1 | 87.9 | 55.8 | 72.1 |