Sentiment Analysis on SST2 (Accuracy)
94.9541AccuracyFRA
Evaluation Results
| Method | Links | |
|---|---|---|
| FRABackbone=RoBERTa-base, Adapter=LoRA, Setting=Balanced (i.i.d.)2025.01 | 94.9541 | |
| FEDAVGBackbone=RoBERTa-base, Adapter=LoRA, Setting=Balanced (i.i.d.)2025.01 | 94.8394 | |
| DCBackbone Model=Llama, Shot Count=16-shot2025.05 | 94.77 | |
| DCModel=Llama, k-shot=162025.05 | 94.77 | |
| FFABackbone=RoBERTa-base, Adapter=LoRA, Setting=Balanced (i.i.d.)2025.01 | 94.7248 | |
| CENTRALISEDBackbone=RoBERTa-base, Setting=Balanced (i.i.d.)2025.01 | 94.7248 | |
| DCBackbone Model=Mistral, Shot Count=16-shot2025.05 | 94.69 | |
| DCModel=Mistral, k-shot=162025.05 | 94.69 | |
| CCBackbone Model=Llama, Shot Count=16-shot2025.05 | 94.61 | |
| BCBackbone Model=Llama, Shot Count=16-shot2025.05 | 94.61 | |
| CCModel=Llama, k-shot=162025.05 | 94.61 | |
| BCModel=Llama, k-shot=162025.05 | 94.61 | |
| Base LLMBackbone Model=Llama, Shot Count=16-shot2025.05 | 94.45 | |
| Base LLMModel=Llama, k-shot=162025.05 | 94.45 | |
| SCBackbone Model=Mistral, Shot Count=16-shot2025.05 | 94.3 | |
| SCModel=Mistral, k-shot=162025.05 | 94.3 | |
| CCBackbone Model=Mistral, Shot Count=16-shot2025.05 | 94.06 | |
| CCModel=Mistral, k-shot=162025.05 | 94.06 | |
| BERT2026.04 | 94 | |
| SCBackbone Model=Llama, Shot Count=16-shot2025.05 | 93.98 | |
| Base LLMBackbone Model=Mistral, Shot Count=16-shot2025.05 | 93.98 | |
| SCModel=Llama, k-shot=162025.05 | 93.98 | |
| Base LLMModel=Mistral, k-shot=162025.05 | 93.98 | |
| BCBackbone Model=Mistral, Shot Count=16-shot2025.05 | 93.52 | |
| BCModel=Mistral, k-shot=162025.05 | 93.52 | |
| SCBackbone Model=Qwen, Shot Count=16-shot2025.05 | 93.2 | |
| SCModel=Qwen, k-shot=162025.05 | 93.2 | |
| CCBackbone Model=Qwen, Shot Count=16-shot2025.05 | 92.66 | |
| CCModel=Qwen, k-shot=162025.05 | 92.66 | |
| ConMeZOModel=OPT-13B2025.11 | 92.39 | |
| BCBackbone Model=Qwen, Shot Count=16-shot2025.05 | 91.41 | |
| BCModel=Qwen, k-shot=162025.05 | 91.41 | |
| MeZOModel=OPT-13B2025.11 | 91.25 | |
| ConMeZOModel=OPT-1.3B2025.11 | 90.56 | |
| MeZOModel=OPT-1.3B2025.11 | 88.49 | |
| Base LLMBackbone Model=Qwen, Shot Count=16-shot2025.05 | 87.66 | |
| Base LLMModel=Qwen, k-shot=162025.05 | 87.66 | |
| LLM-Guided TM2026.04 | 85.24 | |
| DCBackbone Model=Qwen, Shot Count=16-shot2025.05 | 84.14 | |
| DCModel=Qwen, k-shot=162025.05 | 84.14 | |
| char-CNN2026.04 | 80.78 | |
| RNN/LSTMEmbedding=GloVe2026.04 | 80.35 | |
| fastTexth=102026.04 | 80.1 | |
| RNN/LSTM2026.04 | 77.5 | |
| TMEmbedding=GloVe2026.04 | 76.38 | |
| TM2026.04 | 75.61 | |
| BoW TFIDF2026.04 | 75.5 |