Few-shot Text Classification on Aggregated Text Datasets
2.73Accuracy DifferenceACSESSWeighted
Evaluation Results
| Method | Links | |
|---|---|---|
| ACSESSWeightedModel=GEMMA, Evaluation Protocol=ICL2024.02 | 2.73 | |
| ACSESSWeightedModel=Mistral, Evaluation Protocol=ICL2024.02 | 2.55 | |
| ACSESSWeightedModel=LLAMA, Evaluation Protocol=ICL2024.02 | 2.48 | |
| CASEModel=Mistral, Evaluation Protocol=ICL2024.02 | 2.4 | |
| ACSESSUniformModel=Mistral, Evaluation Protocol=ICL2024.02 | 2.3 | |
| EXPLORAModel=Mistral, Evaluation Protocol=ICL2024.02 | 2.17 | |
| ACSESSWeightedModel=Zephyr, Evaluation Protocol=ICL2024.02 | 2.15 | |
| ACSESSWeightedModel=QWEN, Evaluation Protocol=ICL2024.02 | 2.09 | |
| Active PromptModel=Mistral, Evaluation Protocol=ICL2024.02 | 1.89 | |
| ACSESSWith RandomModel=Mistral, Evaluation Protocol=ICL2024.02 | 1.78 | |
| LENSModel=Mistral, Evaluation Protocol=ICL2024.02 | 1.73 | |
| CartographyHardModel=Mistral, Evaluation Protocol=ICL2024.02 | 1.6 | |
| ACSESSWeightedModel=MAML, Evaluation Protocol=FSL2024.02 | 1.49 | |
| ForgettingModel=Mistral, Evaluation Protocol=ICL2024.02 | 1.27 | |
| ACSESSWeightedModel=FT, Evaluation Protocol=FSL2024.02 | 1.07 | |
| EntropyModel=Mistral, Evaluation Protocol=ICL2024.02 | 1.02 | |
| ACSESSWeightedModel=PROTONET, Evaluation Protocol=FSL2024.02 | 1.02 | |
| MarginModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.93 | |
| DiversityModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.66 | |
| CraigModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.66 | |
| GlisterModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.64 | |
| LossModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.56 | |
| Least ConfidenceModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.49 | |
| RandomModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.46 | |
| Graph-CutModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.42 | |
| DeepFoolModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.4 | |
| CALModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.39 | |
| GrandModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.29 | |
| SimilarityModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.24 | |
| HerdingModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.24 | |
| CartographyAmbiguousModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.21 | |
| CartographyEasy+Ambig.Model=Mistral, Evaluation Protocol=ICL2024.02 | 0.21 | |
| CartographyEasyModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.16 | |
| KCenterModel=Mistral, Evaluation Protocol=ICL2024.02 | 0.13 | |
| ClassicModel=Mistral, Evaluation Protocol=ICL2024.02 | 0 |