List your company
ResearchFormerly WizWand

Few-shot text classification on LAMA

28.8AccuracyICT
0.3047.70215.122.498Oct 15, 2021
Updated 8mo ago

Evaluation results

MethodLinks
ICTBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=With instructions2021.1028.8
ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=Without instructions2021.1027.6
ICTBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=With instructions2021.1027.5
InsT + FTBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=With instructions2021.1027
ICTBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=With instructions2021.1026
ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=Without instructions2021.1026
InsT + FTBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=With instructions2021.1025.6
InsT + FTBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=With instructions2021.1024.7
ICTBackbone=BERT-Large, K-shot=5-shot, Instruction presence=With instructions2021.1024.3
InsT + FTBackbone=BERT-Large, K-shot=5-shot, Instruction presence=With instructions2021.1023.9
Raw IC-LBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=With instructions2021.1023.7
ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=Without instructions2021.1023.5
ICTBackbone=BERT-Large, K-shot=2-shot, Instruction presence=With instructions2021.1023.4
ICT w/o InsBackbone=BERT-Large, K-shot=5-shot, Instruction presence=Without instructions2021.1022.9
InsT + FTBackbone=BERT-Large, K-shot=2-shot, Instruction presence=With instructions2021.1022.6
Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=5-shot, Instruction presence=Without instructions2021.1022.6
ICTBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=With instructions2021.1021.9
InsT + FTBackbone=BERT-Large, K-shot=1-shot, Instruction presence=With instructions2021.1021.6
ICTBackbone=BERT-Large, K-shot=1-shot, Instruction presence=With instructions2021.1021.6
Raw IC-LBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=With instructions2021.1020.6
InsT + FTBackbone=BERT-Base, K-shot=5-shot, Instruction presence=With instructions2021.1020
ICT w/o InsBackbone=BERT-Large, K-shot=2-shot, Instruction presence=Without instructions2021.1019.9
ICTBackbone=BERT-Base, K-shot=5-shot, Instruction presence=With instructions2021.1019.6
Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=2-shot, Instruction presence=Without instructions2021.1019.5
ICT w/o InsBackbone=BERT-Large, K-shot=1-shot, Instruction presence=Without instructions2021.1019.4
Raw IC-LBackbone=BERT-Large, K-shot=5-shot, Instruction presence=With instructions2021.1018.6
InsT + FTBackbone=BERT-Base, K-shot=2-shot, Instruction presence=With instructions2021.1018.6
ICT w/o InsBackbone=BERT-Base, K-shot=5-shot, Instruction presence=Without instructions2021.1018.2
ICTBackbone=BERT-Large, K-shot=0-shot, Instruction presence=With instructions2021.1018
ICTBackbone=BERT-Base, K-shot=2-shot, Instruction presence=With instructions2021.1017.6
InsT + FTBackbone=BERT-Base, K-shot=1-shot, Instruction presence=With instructions2021.1017.5
ICT w/o InsBackbone=BERT-Base, K-shot=2-shot, Instruction presence=Without instructions2021.1017
ICTBackbone=BERT-Base, K-shot=1-shot, Instruction presence=With instructions2021.1016.3
Raw IC-LBackbone=BERT-Large, K-shot=2-shot, Instruction presence=With instructions2021.1015.4
ICTBackbone=BERT-Base, K-shot=0-shot, Instruction presence=With instructions2021.1014.6
ICT w/o InsBackbone=BERT-Base, K-shot=1-shot, Instruction presence=Without instructions2021.1014.6
Raw IC-LBackbone=BERT-Base, K-shot=5-shot, Instruction presence=With instructions2021.1014.1
Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=Without instructions2021.1013
Raw IC-LBackbone=BERT-Large, K-shot=0-shot, Instruction presence=With instructions2021.1012.7
Raw IC-LBackbone=DeBERTa-xlarge, K-shot=1-shot, Instruction presence=With instructions2021.1012.6
Raw IC-L w/o InsBackbone=BERT-Large, K-shot=5-shot, Instruction presence=Without instructions2021.1012.5
Raw IC-L w/o InsBackbone=BERT-Base, K-shot=5-shot, Instruction presence=Without instructions2021.1012.3
Raw IC-LBackbone=BERT-Large, K-shot=1-shot, Instruction presence=With instructions2021.1012.1
Raw IC-LBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=With instructions2021.1011.2
Raw IC-LBackbone=BERT-Base, K-shot=2-shot, Instruction presence=With instructions2021.1010.8
ICT w/o InsBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=Without instructions2021.1010.6
Raw IC-LBackbone=BERT-Base, K-shot=0-shot, Instruction presence=With instructions2021.1010.3
ICT w/o InsBackbone=BERT-Large, K-shot=0-shot, Instruction presence=Without instructions2021.109.3
Raw IC-L w/o InsBackbone=BERT-Base, K-shot=2-shot, Instruction presence=Without instructions2021.108.7
Raw IC-LBackbone=BERT-Base, K-shot=1-shot, Instruction presence=With instructions2021.108.5
ICT w/o InsBackbone=BERT-Base, K-shot=0-shot, Instruction presence=Without instructions2021.107.1
Raw IC-L w/o InsBackbone=BERT-Large, K-shot=2-shot, Instruction presence=Without instructions2021.107
Raw IC-L w/o InsBackbone=BERT-Base, K-shot=1-shot, Instruction presence=Without instructions2021.104.9
Raw IC-L w/o InsBackbone=BERT-Large, K-shot=1-shot, Instruction presence=Without instructions2021.103.5
Raw IC-L w/o InsBackbone=DeBERTa-xlarge, K-shot=0-shot, Instruction presence=Without instructions2021.102.7
Raw IC-L w/o InsBackbone=BERT-Base, K-shot=0-shot, Instruction presence=Without instructions2021.101.5
Raw IC-L w/o InsBackbone=BERT-Large, K-shot=0-shot, Instruction presence=Without instructions2021.101.4