Natural Language Understanding on T0 Evaluation Suite IA3 PEFT (held-out)
71.9RTETA
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TAMerging Protocol=IA3 PEFT2025.12 | 71.9 | 56.2 | 53.1 | 29.6 | 65.6 | 78.1 | 46.9 | 87.5 | 46.9 | 28.1 | 25 | 53.5 | |
| TIESMerging Protocol=IA3 PEFT2025.12 | 71.9 | 59.4 | 53.1 | 31.2 | 62.5 | 79.6 | 46.9 | 87.5 | 46.9 | 31.2 | 25 | 54.1 | |
| DAREMerging Protocol=IA3 PEFT2025.12 | 71.9 | 59.4 | 53.1 | 29.6 | 62.5 | 78.1 | 43.8 | 87.5 | 46.9 | 28.1 | 25 | 53.3 | |
| TAMerging Protocol=IA3 PEFT, Calibration=WSC2025.12 | 71.9 | 59.4 | 53.1 | 29.6 | 62.5 | 79.6 | 46.9 | 87.5 | 50 | 31.2 | 25 | 54.2 | |
| TIESMerging Protocol=IA3 PEFT, Calibration=WSC2025.12 | 71.9 | 59.4 | 53.1 | 29.6 | 65.6 | 78.1 | 46.9 | 87.5 | 46.9 | 31.2 | 25 | 54.1 | |
| DAREMerging Protocol=IA3 PEFT, Calibration=WSC2025.12 | 71.9 | 59.4 | 53.1 | 29.6 | 64.1 | 78.1 | 46.9 | 87.5 | 46.9 | 31.2 | 25 | 54 |