Sentiment Analysis on SST-2
96.9AccuracyRLLR
Evaluation Results
| Method | Links | |
|---|---|---|
| RLLRBackbone=Mistral 7B2024.05 | 96.9 | |
| RLLRBackbone=LLaMA2 7B2024.05 | 96.79 | |
| RLLR_MIXEDBackbone=LLaMA2 7B2024.05 | 96.79 | |
| RLLR_MIXEDBackbone=Mistral 7B2024.05 | 96.67 | |
| SFT w. rat.Backbone=LLaMA2 7B2024.05 | 96.56 | |
| RLHFBackbone=LLaMA2 7B2024.05 | 96.44 | |
| RLLR_MIXEDBackbone=Baichuan2 7B2024.05 | 96.44 | |
| SFT w. rat.Backbone=Mistral 7B2024.05 | 96.33 | |
| RLLRBackbone=Baichuan2 7B2024.05 | 96.33 | |
| SFTBackbone=LLaMA2 7B2024.05 | 96.22 | |
| RLHFBackbone=Mistral 7B2024.05 | 96.22 | |
| RLHFBackbone=Baichuan2 7B2024.05 | 96.22 | |
| SFT w. rat.Backbone=Baichuan2 7B2024.05 | 95.99 | |
| SFT w. rat.Backbone=ChatGLM3 6B2024.05 | 95.87 | |
| RLHFBackbone=ChatGLM3 6B2024.05 | 95.87 | |
| RLLRBackbone=ChatGLM3 6B2024.05 | 95.87 | |
| RLLR_MIXEDBackbone=ChatGLM3 6B2024.05 | 95.87 | |
| SFTBackbone=Baichuan2 7B2024.05 | 95.64 | |
| RLLRBackbone=Bloom 7B2024.05 | 95.53 | |
| SFTBackbone=ChatGLM3 6B2024.05 | 95.3 | |
| SFTBackbone=Mistral 7B2024.05 | 95.18 | |
| SFT w. rat.Backbone=Bloom 7B2024.05 | 94.61 | |
| RLHFBackbone=Bloom 7B2024.05 | 94.61 | |
| RLLR_MIXEDBackbone=Bloom 7B2024.05 | 94.61 | |
| SFTBackbone=Bloom 7B2024.05 | 94.38 | |
| Standard MHAMemory (GB)=15.22025.12 | 93.5 | |
| MAHAMemory (GB)=6.72025.12 | 93.3 | |
| BigBirdMemory (GB)=10.32025.12 | 93.1 | |
| LongformerMemory (GB)=9.12025.12 | 92.8 | |
| PerformerMemory (GB)=8.52025.12 | 92.4 | |
| ReformerMemory (GB)=7.82025.12 | 91.7 |