Sentiment Analysis on Amazon
62.84AccuracyShadowPEFT
Evaluation results
| Method | Links | |
|---|---|---|
| ShadowPEFTTrainable Params=29,118,720, Backbone Model=Qwen3 8B, Inference Mode=Shadow-attached2026.04 | 62.84 | |
| ShadowPEFT w/ pretrained shadowTrainable Params=454,991,872, Backbone Model=Qwen3 8B + 0.5B Shadow, Inference Mode=Shadow-attached, Shadow Model Initialization=pretrained2026.04 | 62.72 | |
| ShadowPEFT w/ random shadowTrainable Params=454,991,872, Backbone Model=Qwen3 8B + 0.5B Shadow, Inference Mode=Shadow-attached, Shadow Model Initialization=random2026.04 | 62.68 | |
| ShadowPEFTTrainable Params=23,442,176, Backbone Model=Qwen3 4B, Inference Mode=Shadow-attached2026.04 | 62.66 | |
| LoRATrainable Params=30,670,848, Backbone Model=Qwen3 8B2026.04 | 62.42 | |
| DoRATrainable Params=31,039,488, Backbone Model=Qwen3 8B2026.04 | 62.22 | |
| DoRATrainable Params=23,906,304, Backbone Model=Qwen3 4B2026.04 | 62.02 | |
| LoRATrainable Params=23,592,960, Backbone Model=Qwen3 4B2026.04 | 61.78 | |
| ShadowPEFTTrainable Params=9,073,920, Backbone Model=Qwen3 0.6B, Inference Mode=Shadow-attached2026.04 | 61.18 | |
| DoRATrainable Params=9,318,400, Backbone Model=Qwen3 0.6B2026.04 | 60.92 | |
| Detached Shadow Only (pretrained)Trainable Params=454,991,872, Backbone Model=Qwen3 8B + 0.5B Shadow, Inference Mode=Detached, Shadow Model Initialization=pretrained2026.04 | 60.52 | |
| LoRATrainable Params=9,175,040, Backbone Model=Qwen3 0.6B2026.04 | 60.4 | |
| Detached Shadow OnlyTrainable Params=23,442,176, Backbone Model=Qwen3 4B, Inference Mode=Detached2026.04 | 51.88 | |
| Detached Shadow OnlyTrainable Params=9,073,920, Backbone Model=Qwen3 0.6B, Inference Mode=Detached2026.04 | 50.9 | |
| Detached Shadow OnlyTrainable Params=29,118,720, Backbone Model=Qwen3 8B, Inference Mode=Detached2026.04 | 47.24 | |
| Detached Shadow Only (random)Trainable Params=454,991,872, Backbone Model=Qwen3 8B + 0.5B Shadow, Inference Mode=Detached, Shadow Model Initialization=random2026.04 | 46.84 |