Sentiment Analysis on IMDB (val)
93.3AccuracyBERT-base
Evaluation results
| Method | Links | |
|---|---|---|
| BERT-baseEvaluation protocol=Fine-tuned2021.02 | 93.3 | |
| NyströmformerEvaluation protocol=Fine-tuned2021.02 | 93.2 | |
| BaselineBackbone=DistilBERT-base, Evaluation Protocol=Full fine-tuning, #Params (%)=100.0, Time (min)=8.922025.12 | 92.08 | |
| Q-RUNBackbone=DistilBERT-base, Evaluation Protocol=Adapter fine-tuning, Rank (r)=8, #Params (%)=0.2255, Time (min)=7.662025.12 | 91.28 | |
| Q-RUNBackbone=DistilBERT-base, Evaluation Protocol=Adapter fine-tuning, Rank (r)=4, #Params (%)=0.1165, Time (min)=7.512025.12 | 91.12 | |
| DoRABackbone=DistilBERT-base, Evaluation Protocol=Adapter fine-tuning, Rank (r)=4, #Params (%)=0.1240, Time (min)=7.322025.12 | 90.78 | |
| LoRABackbone=DistilBERT-base, Evaluation Protocol=Adapter fine-tuning, Rank (r)=4, #Params (%)=0.1105, Time (min)=7.252025.12 | 90.7 | |
| DoRABackbone=DistilBERT-base, Evaluation Protocol=Adapter fine-tuning, Rank (r)=8, #Params (%)=0.2330, Time (min)=9.492025.12 | 90.66 | |
| LoRABackbone=DistilBERT-base, Evaluation Protocol=Adapter fine-tuning, Rank (r)=8, #Params (%)=0.2195, Time (min)=7.362025.12 | 90.08 | |
| MetaAdamWTime Overhead=+172.53%2026.04 | 82.79 | |
| AdamWTime Overhead=0%2026.04 | 74.53 |