Sentiment Analysis on Yelp (test)
84.8AccuracyBERT Seq-CLS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BERT Seq-CLSTraining Strategy=individual2023.05 | 84.8 | — | |
| Qwen2.5-7B-LoRABackbone=Qwen2.5-7B, Adaptation=LoRA, Time=2:23:52, Memory=255602025.12 | 82.96 | — | |
| Qwen2.5-7B-FreezeBackbone=Qwen2.5-7B, Adaptation=Freeze, Time=0:44:52, Memory=328142025.12 | 82.79 | — | |
| Qwen2.5-7B-QLoRABackbone=Qwen2.5-7B, Adaptation=QLoRA, Time=2:46:19, Memory=161722025.12 | 82.72 | — | |
| EABackbone=Qwen2.5-7B, Adaptation=EA, Time=0:09:18, Memory=29622025.12 | 82.54 | — | |
| Qwen2.5-7BBackbone=Qwen2.5-7B, Adaptation=None2025.12 | 82.16 | — | |
| EABackbone=Llama-3-8B, Adaptation=EA, Time=0:09:39, Memory=29622025.12 | 81.53 | — | |
| Llama-3-8B-LoRABackbone=Llama-3-8B, Adaptation=LoRA, Time=2:12:06, Memory=256262025.12 | 81.21 | — | |
| Llama-3-8B-QLoRABackbone=Llama-3-8B, Adaptation=QLoRA, Time=2:57:29, Memory=150982025.12 | 81.09 | — | |
| Llama-3-8B-FreezeBackbone=Llama-3-8B, Adaptation=Freeze, Time=0:47:34, Memory=308262025.12 | 80.92 | — | |
| Llama-3-8BBackbone=Llama-3-8B, Adaptation=None2025.12 | 80.39 | — | |
| BERT Seq-CLSTraining Strategy=full2023.05 | 79 | — | |
| Final-exitOffloading cost=5λ2023.09 | 77.8 | 161 | |
| GPT-3Training Strategy=Zero-shot2023.05 | 77 | — | |
| BARTTraining Strategy=Zero-shot2023.05 | 75.2 | — | |
| GPT-2Training Strategy=implicit2023.05 | 71.9 | — | |
| GPT-2Training Strategy=explicit2023.05 | 71.5 | — | |
| GPT-2Training Strategy=vanilla2023.05 | 70.9 | — | |
| Binary BERTTraining Strategy=implicit2023.05 | 59.8 | — | |
| Binary BERTTraining Strategy=vanilla2023.05 | 58.5 | — | |
| Bi-EncoderTraining Strategy=implicit2023.05 | 56.8 | — | |
| Binary BERTTraining Strategy=explicit2023.05 | 56 | — | |
| Bi-EncoderTraining Strategy=explicit2023.05 | 52.1 | — | |
| Bi-EncoderTraining Strategy=vanilla2023.05 | 46.5 | — | |
| SplitEEOffloading cost=5λ2023.09 | -1.1 | -68.3 | |
| SplitEE-SOffloading cost=5λ2023.09 | -1.1 | -65.2 | |
| Random-exitOffloading cost=5λ2023.09 | -1.2 | -38 | |
| ElasticBERTOffloading cost=5λ2023.09 | -2.1 | -62.1 | |
| DeeBERTOffloading cost=5λ2023.09 | -2.5 | -59 |