Sentiment Analysis on SST-2 (top-1 accuracy)
97Top-1 Accuracy (SST-2)ReLoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| ReLoRAUpdate Source=OpenOrca, Evaluation Protocol=Task-adaptation Methods2026.05 | 97 | |
| ReLoRAUpdate Source=OpenPlatypus, Evaluation Protocol=Task-adaptation Methods2026.05 | 97 | |
| ReLoRAUpdate Source=AlpacaGPT4, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.9 | |
| PortLLM+FTUpdate Source=OpenOrca, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.6 | |
| ORALUpdate Source=OpenOrca, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.4 | |
| PortLLM+FTUpdate Source=AlpacaGPT4, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.4 | |
| PortLLM+FTUpdate Source=OpenPlatypus, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.4 | |
| LoRA-ScratchUpdate Source=OpenOrca, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.3 | |
| ORALUpdate Source=OpenPlatypus, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.2 | |
| LoRA-ScratchUpdate Source=AlpacaGPT4, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.1 | |
| LoRA-ScratchUpdate Source=OpenPlatypus, Evaluation Protocol=Task-adaptation Methods2026.05 | 96.1 | |
| ORALUpdate Source=AlpacaGPT4, Evaluation Protocol=Task-adaptation Methods2026.05 | 96 | |
| ZO Fine-tunerBackbone=LLaMA-3.1-8B2025.10 | 94 | |
| ZO Fine-tunerBackbone=Qwen2.5-14B2025.10 | 94 | |
| FOBackbone=Qwen2.5-14B2025.10 | 94 | |
| FOBackbone=LLaMA-3.2-1B2025.10 | 93 | |
| FOBackbone=LLaMA-3.1-8B2025.10 | 93 | |
| MeZOBackbone=LLaMA-3.1-8B2025.10 | 92 | |
| ZO Fine-tunerBackbone=LLaMA-3.2-1B2025.10 | 92 | |
| ICRBackbone=Qwen2.5-7B2025.09 | 91 | |
| MeZOBackbone=LLaMA-3.2-1B2025.10 | 90 | |
| MeZOBackbone=Qwen2.5-14B2025.10 | 88 | |
| ICVBackbone=Qwen2.5-7B2025.09 | 83 | |
| ELICITBackbone=Qwen2.5-7B2025.09 | 78.5 | |
| IVBackbone=Qwen2.5-7B2025.09 | 78.4 | |
| TVBackbone=Qwen2.5-7B2025.09 | 78.2 | |
| FVBackbone=Qwen2.5-7B2025.09 | 76.8 | |
| WUDI-Merging + E-PMQMerging Strategy=WUDI-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 69.52 | |
| WUDI-MergingMerging Strategy=WUDI-Merging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 69 | |
| WUDI-Merging + GPTQMerging Strategy=WUDI-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 67.76 | |
| WUDI-Merging + RTNMerging Strategy=WUDI-Merging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 67.49 | |
| WUDI-Merging + AWQMerging Strategy=WUDI-Merging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 67 | |
| TIES-Merging + E-PMQMerging Strategy=TIES-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 65.79 | |
| Simple Averaging + E-PMQMerging Strategy=Simple Averaging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 65.57 | |
| Task Arithmetic + E-PMQMerging Strategy=Task Arithmetic, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 64.74 | |
| Simple AveragingMerging Strategy=Simple Averaging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 61.8 | |
| Simple Averaging + GPTQMerging Strategy=Simple Averaging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 58.59 | |
| Pretrained LLM ΘEvaluation Protocol=Zero-shot2026.05 | 56.9 | |
| Simple Averaging + RTNMerging Strategy=Simple Averaging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 56.89 | |
| Simple Averaging + AWQMerging Strategy=Simple Averaging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 56.84 | |
| TIES-Merging + GPTQMerging Strategy=TIES-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 56.18 | |
| Evolved LLM Θ′Update Source=OpenOrca, Evaluation Protocol=Zero-shot2026.05 | 56 | |
| TIES-MergingMerging Strategy=TIES-Merging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 55.9 | |
| Task Arithmetic + GPTQMerging Strategy=Task Arithmetic, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 55.02 | |
| TIES-Merging + AWQMerging Strategy=TIES-Merging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 53.82 | |
| TIES-Merging + RTNMerging Strategy=TIES-Merging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 53.43 | |
| Task Arithmetic + AWQMerging Strategy=Task Arithmetic, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 52.28 | |
| Task Arithmetic + RTNMerging Strategy=Task Arithmetic, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 52.22 | |
| Evolved LLM Θ′Update Source=OpenPlatypus, Evaluation Protocol=Zero-shot2026.05 | 52.2 | |
| Evolved LLM Θ′Update Source=AlpacaGPT4, Evaluation Protocol=Zero-shot2026.05 | 51.6 | |
| Task ArithmeticMerging Strategy=Task Arithmetic, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 51.2 |