Sentiment Analysis on MR
0.939AccuracyICL
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ICLBackbone=Llama-2 70B, Shots=128-shots2024.05 | 0.939 | — | |
| FADS-ICLBackbone=Llama-1 30B, Shots=128-shots2024.05 | 0.938 | — | |
| FADS-ICLBackbone=Llama-1 13B, Shots=128-shots2024.05 | 0.934 | — | |
| FADS-ICLBackbone=Llama-2 13B, Shots=128-shots2024.05 | 0.934 | — | |
| RLLRBackbone=Mistral 7B2024.05 | 0.933 | — | |
| kNN-promptBackbone=Llama-2 7B, Shots=128-shots2024.05 | 0.932 | — | |
| CCModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 0.932 | — | |
| kNN-promptingBackbone=Llama-1 13B, Shots=128-shots2024.05 | 0.931 | — | |
| FADS-ICLBackbone=Llama-2 70B, Shots=128-shots2024.05 | 0.93 | — | |
| DCModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 0.93 | — | |
| ICLBackbone=Llama-2 7B, Shots=128-shots2024.05 | 0.929 | — | |
| PCModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 0.928 | — | |
| kNN-promptBackbone=Llama-1 7B, Shots=128-shots2024.05 | 0.927 | — | |
| kNN-promptBackbone=Llama-1 13B, Shots=128-shots2024.05 | 0.927 | — | |
| kNN-promptBackbone=Llama-2 13B, Shots=128-shots2024.05 | 0.927 | — | |
| RLLR_MIXEDBackbone=LLaMA2 7B2024.05 | 0.926 | — | |
| RLLRMIXEDModel=LLaMA2, Model Size=7B2024.05 | 0.926 | — | |
| RLLRModel=LLaMA2, Model Size=13B2024.05 | 0.926 | — | |
| RLLRBackbone=LLaMA2 7B2024.05 | 0.924 | — | |
| RLLR_MIXEDBackbone=Mistral 7B2024.05 | 0.924 | — | |
| RLLRModel=LLaMA2, Model Size=7B2024.05 | 0.924 | — | |
| RLLRMIXEDModel=LLaMA2, Model Size=13B2024.05 | 0.924 | — | |
| FADS-ICLBackbone=Llama-1 7B, Shots=128-shots2024.05 | 0.924 | — | |
| DCModel=Llama-2 7b, ICL Setting=1-shot2024.05 | 0.9235 | — | |
| UniBiasModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 0.9223 | — | |
| SFT w. rat.Model=LLaMA2, Model Size=13B2024.05 | 0.922 | — | |
| RLHFModel=LLaMA2, Model Size=13B2024.05 | 0.922 | — | |
| kNN-promptingBackbone=Llama-2 7B, Shots=128-shots2024.05 | 0.922 | — | |
| FADS-ICLBackbone=Llama-2 7B, Shots=128-shots2024.05 | 0.922 | — | |
| kNN-promptingBackbone=Llama-2 13B, Shots=128-shots2024.05 | 0.922 | — | |
| kNN-promptingBackbone=Llama-1 30B, Shots=128-shots2024.05 | 0.922 | — | |
| UniBiasModel=Llama-2 7b, ICL Setting=1-shot2024.05 | 0.9219 | — | |
| SFTBackbone=Mistral 7B2024.05 | 0.921 | — | |
| RLHFBackbone=Mistral 7B2024.05 | 0.921 | — | |
| SFT w. rat.Backbone=Mistral 7B2024.05 | 0.92 | — | |
| SFTModel=LLaMA2, Model Size=13B2024.05 | 0.92 | — | |
| SFT w. rat.Backbone=LLaMA2 7B2024.05 | 0.919 | — | |
| RLHFBackbone=LLaMA2 7B2024.05 | 0.919 | — | |
| SFT w. rat.Model=LLaMA2, Model Size=7B2024.05 | 0.919 | — | |
| RLHFModel=LLaMA2, Model Size=7B2024.05 | 0.919 | — | |
| kNN-promptingBackbone=Llama-1 7B, Shots=128-shots2024.05 | 0.918 | — | |
| CCModel=Llama-2 7b, ICL Setting=1-shot2024.05 | 0.9177 | — | |
| kNN-promptBackbone=Llama-2 70B, Shots=128-shots2024.05 | 0.917 | — | |
| kNN-promptingBackbone=Llama-2 70B, Shots=128-shots2024.05 | 0.916 | — | |
| kNN-promptBackbone=Llama-1 30B, Shots=128-shots2024.05 | 0.915 | — | |
| RLLRBackbone=ChatGLM3 6B2024.05 | 0.914 | — | |
| RLLR_MIXEDBackbone=ChatGLM3 6B2024.05 | 0.914 | — | |
| PCModel=Llama-2 7b, ICL Setting=1-shot2024.05 | 0.9139 | — | |
| SFT w. rat.Backbone=ChatGLM3 6B2024.05 | 0.913 | — | |
| RLLRBackbone=Baichuan2 7B2024.05 | 0.913 | — | |
| RLHFBackbone=Baichuan2 7B2024.05 | 0.912 | — | |
| RLLR_MIXEDBackbone=Baichuan2 7B2024.05 | 0.912 | — | |
| ICLBackbone=Llama-1 30B, Shots=128-shots2024.05 | 0.912 | — | |
| RLHFBackbone=ChatGLM3 6B2024.05 | 0.911 | — | |
| SFTBackbone=LLaMA2 7B2024.05 | 0.91 | — | |
| SFTModel=LLaMA2, Model Size=7B2024.05 | 0.91 | — | |
| SFTBackbone=Baichuan2 7B2024.05 | 0.908 | — | |
| SFT w. rat.Backbone=Baichuan2 7B2024.05 | 0.907 | — | |
| RLLRBackbone=Bloom 7B2024.05 | 0.901 | — | |
| RLLRModel=Bloom, Model Size=7B2024.05 | 0.901 | — | |
| ICLModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 0.901 | — | |
| RLLRModel=Bloom, Model Size=3B2024.05 | 0.898 | — | |
| RLHFBackbone=Bloom 7B2024.05 | 0.897 | — | |
| RLHFModel=Bloom, Model Size=7B2024.05 | 0.897 | — | |
| SFT w. rat.Backbone=Bloom 7B2024.05 | 0.895 | — | |
| RLLR_MIXEDBackbone=Bloom 7B2024.05 | 0.895 | — | |
| SFT w. rat.Model=Bloom, Model Size=7B2024.05 | 0.895 | — | |
| RLLRMIXEDModel=Bloom, Model Size=7B2024.05 | 0.895 | — | |
| RLLRMIXEDModel=Bloom, Model Size=3B2024.05 | 0.894 | — | |
| ICLModel=Llama-2 7b, ICL Setting=1-shot2024.05 | 0.8937 | — | |
| SFTBackbone=Bloom 7B2024.05 | 0.892 | — | |
| SFTModel=Bloom, Model Size=7B2024.05 | 0.892 | — | |
| SFTBackbone=ChatGLM3 6B2024.05 | 0.89 | — | |
| SFT w. rat.Model=Bloom, Model Size=3B2024.05 | 0.887 | — | |
| RLHFModel=Bloom, Model Size=3B2024.05 | 0.886 | — | |
| SFTModel=Bloom, Model Size=3B2024.05 | 0.884 | — | |
| BERT-12Dim=768, Fine-tuning status=true2021.06 | 0.874 | 0.874 | |
| kNN-promptNumber of training shots (m)=128, LLM scale=1.5B2024.05 | 0.873 | — | |
| kNN-promptBackbone=GPT-2 1.5B, Shots=128-shots2024.05 | 0.873 | — | |
| FADS-ICLNumber of training shots (m)=64, LLM scale=1.5B2024.05 | 0.87 | — | |
| FADS-ICLcandidate pool size (m)=642024.05 | 0.87 | — | |
| kNN-promptingNumber of training shots (m)=32, LLM scale=1.5B2024.05 | 0.864 | — | |
| kNN-promptingNumber of training shots (m)=128, LLM scale=1.5B2024.05 | 0.862 | — | |
| GPT Large FTBackbone=GPT Large, Shots=N/A (Fine-tuned)2024.05 | 0.862 | — | |
| kNN-promptingBackbone=GPT-2 1.5B, Shots=128-shots2024.05 | 0.862 | — | |
| FADS-ICLcandidate pool size (m)=2562024.05 | 0.862 | — | |
| FADS-ICLNumber of training shots (m)=128, LLM scale=1.5B2024.05 | 0.861 | — | |
| FADS-ICLBackbone=GPT-2 1.5B, Shots=128-shots2024.05 | 0.861 | — | |
| FADS-ICLcandidate pool size (m)=1282024.05 | 0.861 | — | |
| FADS-ICLcandidate pool size (m)=322024.05 | 0.859 | — | |
| kNN-promptNumber of training shots (m)=64, LLM scale=1.5B2024.05 | 0.852 | — | |
| kNN-promptBackbone=GPT-2 0.8B, Shots=128-shots2024.05 | 0.85 | — | |
| FADS-ICLBackbone=GPT-2 0.8B, Shots=128-shots2024.05 | 0.85 | — | |
| kNN-promptingNumber of training shots (m)=8, LLM scale=1.5B2024.05 | 0.845 | — | |
| kNN-promptNumber of training shots (m)=32, LLM scale=1.5B2024.05 | 0.845 | — | |
| kNN-promptingNumber of training shots (m)=64, LLM scale=1.5B2024.05 | 0.843 | — | |
| kNN-promptingNumber of training shots (m)=16, LLM scale=1.5B2024.05 | 0.836 | — | |
| BERT Large FTBackbone=BERT Large, Shots=N/A (Fine-tuned)2024.05 | 0.83 | — | |
| kNN-promptingNumber of training shots (m)=4, LLM scale=1.5B2024.05 | 0.829 | — | |
| FADS-ICLNumber of training shots (m)=32, LLM scale=1.5B2024.05 | 0.828 | — |