Sentiment Analysis on IMDb (Accuracy, Average Accuracy)
97.1AccuracyFinetuned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FinetunedBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B2025.12 | 97.1 | 94.4 | |
| SAMergingBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B, k=16002025.12 | 96.4 | 93.5 | |
| TIES-MergingBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B2025.12 | 95.9 | 92.3 | |
| DeBERTaEpochs=10, Max length=5122026.03 | 91.2 | — | |
| InfoMambaEpochs=10, Max length=5122026.03 | 85.1 | — | |
| LinformerEpochs=10, Max length=5122026.03 | 84.4 | — | |
| VMambaEpochs=10, Max length=5122026.03 | 84.2 | — | |
| LocalMambaEpochs=10, Max length=5122026.03 | 83.6 | — | |
| MambaVisionEpochs=10, Max length=5122026.03 | 81.6 | — | |
| Task ArithmeticBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B, lambda=12025.12 | 65.9 | 78.6 | |
| Task ArithmeticBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B, lambda=0.52025.12 | 54.4 | 63.5 | |
| AdaMergingBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B, k=16002025.12 | 54.4 | 63.5 | |
| Pre-trainedBackbone=DeBERTa-V2-XXL, Number of Parameters=1.5B2025.12 | 50 | 41.5 |