Few-shot text classification on LAMA
28.8AccuracyICT
Evaluation Results
| Method | Links | |
|---|---|---|
| ICTBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=With instructions2021.10 | 28.8 | |
| ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=Without instructions2021.10 | 27.6 | |
| ICTBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=With instructions2021.10 | 27.5 | |
| InsT + FTBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=With instructions2021.10 | 27 | |
| ICTBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=With instructions2021.10 | 26 | |
| ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=Without instructions2021.10 | 26 | |
| InsT + FTBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=With instructions2021.10 | 25.6 | |
| InsT + FTBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=With instructions2021.10 | 24.7 | |
| ICTBackbone=BERT-Large, K-shot=5-shot, Instruction presence=With instructions2021.10 | 24.3 | |
| InsT + FTBackbone=BERT-Large, K-shot=5-shot, Instruction presence=With instructions2021.10 | 23.9 | |
| Raw IC-LBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=With instructions2021.10 | 23.7 | |
| ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=Without instructions2021.10 | 23.5 | |
| ICTBackbone=BERT-Large, K-shot=2-shot, Instruction presence=With instructions2021.10 | 23.4 | |
| ICT w/o InsBackbone=BERT-Large, K-shot=5-shot, Instruction presence=Without instructions2021.10 | 22.9 | |
| InsT + FTBackbone=BERT-Large, K-shot=2-shot, Instruction presence=With instructions2021.10 | 22.6 | |
| Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=Without instructions2021.10 | 22.6 | |
| ICTBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=With instructions2021.10 | 21.9 | |
| InsT + FTBackbone=BERT-Large, K-shot=1-shot, Instruction presence=With instructions2021.10 | 21.6 | |
| ICTBackbone=BERT-Large, K-shot=1-shot, Instruction presence=With instructions2021.10 | 21.6 | |
| Raw IC-LBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=With instructions2021.10 | 20.6 | |
| InsT + FTBackbone=BERT-Base, K-shot=5-shot, Instruction presence=With instructions2021.10 | 20 | |
| ICT w/o InsBackbone=BERT-Large, K-shot=2-shot, Instruction presence=Without instructions2021.10 | 19.9 | |
| ICTBackbone=BERT-Base, K-shot=5-shot, Instruction presence=With instructions2021.10 | 19.6 | |
| Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=Without instructions2021.10 | 19.5 | |
| ICT w/o InsBackbone=BERT-Large, K-shot=1-shot, Instruction presence=Without instructions2021.10 | 19.4 | |
| Raw IC-LBackbone=BERT-Large, K-shot=5-shot, Instruction presence=With instructions2021.10 | 18.6 | |
| InsT + FTBackbone=BERT-Base, K-shot=2-shot, Instruction presence=With instructions2021.10 | 18.6 | |
| ICT w/o InsBackbone=BERT-Base, K-shot=5-shot, Instruction presence=Without instructions2021.10 | 18.2 | |
| ICTBackbone=BERT-Large, K-shot=0-shot, Instruction presence=With instructions2021.10 | 18 | |
| ICTBackbone=BERT-Base, K-shot=2-shot, Instruction presence=With instructions2021.10 | 17.6 | |
| InsT + FTBackbone=BERT-Base, K-shot=1-shot, Instruction presence=With instructions2021.10 | 17.5 | |
| ICT w/o InsBackbone=BERT-Base, K-shot=2-shot, Instruction presence=Without instructions2021.10 | 17 | |
| ICTBackbone=BERT-Base, K-shot=1-shot, Instruction presence=With instructions2021.10 | 16.3 | |
| Raw IC-LBackbone=BERT-Large, K-shot=2-shot, Instruction presence=With instructions2021.10 | 15.4 | |
| ICTBackbone=BERT-Base, K-shot=0-shot, Instruction presence=With instructions2021.10 | 14.6 | |
| ICT w/o InsBackbone=BERT-Base, K-shot=1-shot, Instruction presence=Without instructions2021.10 | 14.6 | |
| Raw IC-LBackbone=BERT-Base, K-shot=5-shot, Instruction presence=With instructions2021.10 | 14.1 | |
| Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=Without instructions2021.10 | 13 | |
| Raw IC-LBackbone=BERT-Large, K-shot=0-shot, Instruction presence=With instructions2021.10 | 12.7 | |
| Raw IC-LBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=With instructions2021.10 | 12.6 | |
| Raw IC-L w/o InsBackbone=BERT-Large, K-shot=5-shot, Instruction presence=Without instructions2021.10 | 12.5 | |
| Raw IC-L w/o InsBackbone=BERT-Base, K-shot=5-shot, Instruction presence=Without instructions2021.10 | 12.3 | |
| Raw IC-LBackbone=BERT-Large, K-shot=1-shot, Instruction presence=With instructions2021.10 | 12.1 | |
| Raw IC-LBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=With instructions2021.10 | 11.2 | |
| Raw IC-LBackbone=BERT-Base, K-shot=2-shot, Instruction presence=With instructions2021.10 | 10.8 | |
| ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=Without instructions2021.10 | 10.6 | |
| Raw IC-LBackbone=BERT-Base, K-shot=0-shot, Instruction presence=With instructions2021.10 | 10.3 | |
| ICT w/o InsBackbone=BERT-Large, K-shot=0-shot, Instruction presence=Without instructions2021.10 | 9.3 | |
| Raw IC-L w/o InsBackbone=BERT-Base, K-shot=2-shot, Instruction presence=Without instructions2021.10 | 8.7 | |
| Raw IC-LBackbone=BERT-Base, K-shot=1-shot, Instruction presence=With instructions2021.10 | 8.5 | |
| ICT w/o InsBackbone=BERT-Base, K-shot=0-shot, Instruction presence=Without instructions2021.10 | 7.1 | |
| Raw IC-L w/o InsBackbone=BERT-Large, K-shot=2-shot, Instruction presence=Without instructions2021.10 | 7 | |
| Raw IC-L w/o InsBackbone=BERT-Base, K-shot=1-shot, Instruction presence=Without instructions2021.10 | 4.9 | |
| Raw IC-L w/o InsBackbone=BERT-Large, K-shot=1-shot, Instruction presence=Without instructions2021.10 | 3.5 | |
| Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=Without instructions2021.10 | 2.7 | |
| Raw IC-L w/o InsBackbone=BERT-Base, K-shot=0-shot, Instruction presence=Without instructions2021.10 | 1.5 | |
| Raw IC-L w/o InsBackbone=BERT-Large, K-shot=0-shot, Instruction presence=Without instructions2021.10 | 1.4 |