Text Classification on SST2, SUBJ, MR, RTE, AgNews, CB, SST5
79.7SST2 AccuracyPICL
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| PICLShot=4-shot, Param.=770M2023.05 | 79.7 | 66.8 | 81 | 54.5 | 67.7 | 69.6 | 34.8 | 64.4 | |
| PICLShot=8-shot, Param.=770M2023.05 | 78 | 69.3 | 77.5 | 53 | 64.7 | 70.4 | 34.1 | 63.9 | |
| VanillaICLShot=4-shot, Param.=2.7B2023.05 | 75 | 65.4 | 71.4 | 49.8 | 65.6 | 60 | 32.1 | 59.9 | |
| VanillaICLShot=4-shot, Param.=1.5B2023.05 | 74.9 | 65.2 | 61.9 | 50.4 | 65.6 | 67.8 | 32.4 | 59.7 | |
| MetaICLShot=8-shot, Param.=770M2023.05 | 73.6 | 67.2 | 70.1 | 53.6 | 56.1 | 65.8 | 33.7 | 60 | |
| VanillaICLShot=8-shot, Param.=1.5B2023.05 | 72.1 | 63.4 | 63.3 | 52.7 | 54.2 | 70.4 | 33.5 | 58.6 | |
| VanillaICLShot=8-shot, Param.=2.7B2023.05 | 71 | 65.2 | 70.4 | 51.3 | 63.1 | 69.6 | 34.1 | 60.6 | |
| MetaICLShot=4-shot, Param.=770M2023.05 | 69.8 | 63.5 | 65.6 | 57.6 | 66.3 | 65.2 | 31.7 | 60 | |
| ExtraLMShot=8-shot, Param.=770M2023.05 | 69.7 | 65.2 | 63.6 | 52.6 | 58.9 | 69.6 | 32.2 | 58.8 | |
| ExtraLMShot=4-shot, Param.=770M2023.05 | 68.9 | 63.9 | 60.3 | 51.2 | 64.5 | 63.7 | 27.8 | 57.2 | |
| VanillaICLShot=8-shot, Param.=770M2023.05 | 68.7 | 66.6 | 60.2 | 51.8 | 60.2 | 68.8 | 31.4 | 58.2 | |
| VanillaICLShot=4-shot, Param.=770M2023.05 | 67.5 | 57.7 | 50.3 | 50.8 | 67.5 | 68.1 | 24.4 | 55.2 | |
| Self-SupShot=8-shot, Param.=770M2023.05 | 61.4 | 54.3 | 73.8 | 53 | 52.1 | 63 | 33.7 | 55.9 | |
| Self-SupShot=4-shot, Param.=770M2023.05 | 55 | 50.3 | 59.7 | 52.2 | 50.3 | 63.4 | 28.8 | 51.4 |