Natural Language Inference on CB (val (test))
94.6AccuracyFT
Evaluation results
| Method | Links | |
|---|---|---|
| FTtuning_strategy=fine-tuning2021.09 | 94.6 | |
| PTtuning_strategy=prompt-tuning2021.09 | 94.3 | |
| PPTtuning_strategy=pre-trained prompt tuning2021.09 | 93.7 | |
| Unified PPTtuning_strategy=unified pre-trained prompt tuning2021.09 | 92.9 | |
| HYPERFORMER++_BASEnumber of samples=2502021.06 | 89.63 | |
| HYPERFORMER++_BASEnumber of samples=1002021.06 | 87.41 | |
| Adapters_BASEnumber of samples=2502021.06 | 86.67 | |
| T5_BASEnumber of samples=1002021.06 | 85.93 | |
| T5_BASEnumber of samples=2502021.06 | 85.19 | |
| HYPERFORMER++_BASEnumber of samples=322021.06 | 81.48 | |
| Adapters_BASEnumber of samples=1002021.06 | 80.74 | |
| T5_BASEnumber of samples=322021.06 | 80 | |
| T5_BASEnumber of samples=162021.06 | 77.04 | |
| HYPERFORMER++_BASEnumber of samples=162021.06 | 76.29 | |
| Adapters_BASEnumber of samples=162021.06 | 74.81 | |
| Adapters_BASEnumber of samples=322021.06 | 74.81 | |
| HYPERFORMER++_BASEnumber of samples=42021.06 | 60.74 | |
| T5_BASEnumber of samples=42021.06 | 57.78 | |
| Adapters_BASEnumber of samples=42021.06 | 51.11 |