Image Classification on EuroSAT (Top-1 Accuracy and Delta)
99.3Top-1 AccuracyJACTUS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| JACTUSBackbone=ViT-Large, Budget=80%2026.05 | 99.3 | — | |
| DoRABackbone=ViT-Base, Budget=100%2026.05 | 99.2 | — | |
| PiSSABackbone=ViT-Base, Budget=100%2026.05 | 99.2 | — | |
| JACTUSBackbone=ViT-Base, Budget=80%2026.05 | 99.1 | — | |
| LoRABackbone=ViT-Large, Budget=100%2026.05 | 99 | — | |
| Fine-tuned (STL)Backbone=CLIP-ViT-B/32, Bit-width=Full-precision, Training=Single-task learning2026.05 | 99 | — | |
| DoRABackbone=ViT-Large, Budget=100%2026.05 | 98.9 | — | |
| SVFTBackbone=ViT-Large, Budget=100%2026.05 | 98.8 | — | |
| SVD-LLM+LoRABackbone=ViT-Large, Budget=80%2026.05 | 98.7 | — | |
| JACTUSBackbone=ViT-Large, Budget=60%2026.05 | 98.7 | — | |
| PiSSABackbone=ViT-Large, Budget=100%2026.05 | 98.6 | — | |
| SVFTBackbone=ViT-Base, Budget=100%2026.05 | 98.5 | — | |
| JACTUSBackbone=ViT-Base, Budget=60%2026.05 | 98.5 | — | |
| LoRABackbone=ViT-Base, Budget=100%2026.05 | 98.4 | — | |
| WUDI-MergingMerging Method=WUDI-Merging, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 98.4 | — | |
| SVD-LLM+LoRABackbone=ViT-Base, Budget=80%2026.05 | 98.3 | — | |
| WUDI-Merging w/ E-PMQMerging Method=WUDI-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 97.8 | — | |
| WUDI-Merging w/ GPTQMerging Method=WUDI-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 97.7 | — | |
| SVD-LLM+LoRABackbone=ViT-Large, Budget=60%2026.05 | 97.5 | — | |
| WUDI-Merging w/ RTNMerging Method=WUDI-Merging, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 97.5 | — | |
| JACTUSBackbone=ViT-Large, Budget=40%2026.05 | 96 | — | |
| SVD-LLM+LoRABackbone=ViT-Base, Budget=60%2026.05 | 95.9 | — | |
| JACTUSBackbone=ViT-Base, Budget=40%2026.05 | 95.4 | — | |
| WUDI-MergingBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Bit-width=Full-precision2026.05 | 94.6 | — | |
| SVD-LLM+LoRABackbone=ViT-Large, Budget=40%2026.05 | 93 | — | |
| WUDI-Merging w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=E-PMQ, Bit-width=4-bit2026.05 | 92.9 | — | |
| WUDI-Merging w/ AWQMerging Method=WUDI-Merging, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 92.6 | — | |
| CLIP-LoRA + OursShots=16, Backbone=ViT-B/162026.03 | 92.5 | — | |
| SVD-LLM+LoRABackbone=ViT-Base, Budget=40%2026.05 | 92.4 | — | |
| TIES-MergingMerging Method=TIES-Merging, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 91.3 | — | |
| WUDI-Merging w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=GPTQ, Bit-width=4-bit2026.05 | 90 | — | |
| Simple AveragingMerging Method=Simple Averaging, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 90 | — | |
| TIES-Merging w/ E-PMQMerging Method=TIES-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 87.8 | — | |
| Simple Averaging w/ E-PMQMerging Method=Simple Averaging, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 87.4 | — | |
| Task Arithmetic w/ E-PMQMerging Method=Task Arithmetic, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 87.3 | — | |
| Simple Averaging w/ GPTQMerging Method=Simple Averaging, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 86.5 | — | |
| Task ArithmeticMerging Method=Task Arithmetic, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 86 | — | |
| TIES-Merging w/ GPTQMerging Method=TIES-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 85.6 | — | |
| WUDI-Merging w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=RTN, Bit-width=4-bit2026.05 | 85.5 | — | |
| WUDI-Merging + E-PMQMerging Strategy=WUDI-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 85.44 | — | |
| TIES-Merging w/ RTNMerging Method=TIES-Merging, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 85.2 | — | |
| BiCLIPShots=16, Base Model=CLIP, Adaptation Method=Bilinear adaptation2026.03 | 85.13 | 36.91 | |
| WUDI-Merging w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=AWQ, Bit-width=4-bit2026.05 | 83.9 | — | |
| Simple Averaging w/ RTNMerging Method=Simple Averaging, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 83.2 | — | |
| Task Arithmetic w/ GPTQMerging Method=Task Arithmetic, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 79.7 | — | |
| WUDI-MergingMerging Strategy=WUDI-Merging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 78.5 | — | |
| LDCShots=1, Backbone=ViT-B/162026.03 | 78.4 | — | |
| CLIP-LoRA + OursShots=1, Backbone=ViT-B/162026.03 | 78.4 | — | |
| BiSigLIPShots=16, Base Model=SigLIP, Adaptation Method=Bilinear adaptation2026.03 | 77.5 | 42.15 | |
| Task Arithmetic w/ RTNMerging Method=Task Arithmetic, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 77.1 | — | |
| Simple AveragingBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Bit-width=Full-precision2026.05 | 76.9 | — | |
| TIES-MergingBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Bit-width=Full-precision, Lambda=0.32026.05 | 76.8 | — | |
| Task ArithmeticBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Bit-width=Full-precision, Lambda=0.32026.05 | 76.7 | — | |
| WUDI-Merging + GPTQMerging Strategy=WUDI-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 75.11 | — | |
| TIES-Merging w/ AWQMerging Method=TIES-Merging, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 75 | — | |
| WUDI-Merging + RTNMerging Strategy=WUDI-Merging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 69.7 | — | |
| Task Arithmetic w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=GPTQ, Bit-width=4-bit, Lambda=0.32026.05 | 69.1 | — | |
| Simple Averaging w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=E-PMQ, Bit-width=4-bit2026.05 | 68.6 | — | |
| Simple Averaging w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=GPTQ, Bit-width=4-bit2026.05 | 68 | — | |
| TIES-Merging w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=GPTQ, Bit-width=4-bit, Lambda=0.32026.05 | 67.7 | — | |
| Task Arithmetic w/ AWQMerging Method=Task Arithmetic, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 67.6 | — | |
| WUDI-Merging + AWQMerging Strategy=WUDI-Merging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 67.26 | — | |
| TIES-Merging w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=E-PMQ, Bit-width=4-bit, Lambda=0.32026.05 | 67.2 | — | |
| Task Arithmetic w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=E-PMQ, Bit-width=4-bit, Lambda=0.32026.05 | 66.3 | — | |
| Simple Averaging w/ AWQMerging Method=Simple Averaging, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 66 | — | |
| Task Arithmetic w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=RTN, Bit-width=4-bit, Lambda=0.32026.05 | 62.8 | — | |
| Simple AveragingMerging Strategy=Simple Averaging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 60.9 | — | |
| Simple Averaging + E-PMQMerging Strategy=Simple Averaging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 60.52 | — | |
| Simple Averaging w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=RTN, Bit-width=4-bit2026.05 | 60.2 | — | |
| TIES-Merging w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=RTN, Bit-width=4-bit, Lambda=0.32026.05 | 58.9 | — | |
| Task Arithmetic w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=AWQ, Bit-width=4-bit, Lambda=0.32026.05 | 58.6 | — | |
| TIES-Merging + E-PMQMerging Strategy=TIES-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 57.89 | — | |
| Simple Averaging w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=AWQ, Bit-width=4-bit2026.05 | 57.8 | — | |
| TIES-Merging w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=AWQ, Bit-width=4-bit, Lambda=0.32026.05 | 56.6 | — | |
| Simple Averaging + GPTQMerging Strategy=Simple Averaging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 54.11 | — | |
| Task Arithmetic + E-PMQMerging Strategy=Task Arithmetic, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 50 | — | |
| CLIPShots=0, Base Model=CLIP, Adaptation Method=Zero-Shot2026.03 | 48.22 | — | |
| Simple Averaging + RTNMerging Strategy=Simple Averaging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 46.26 | — | |
| Pre-trainedBackbone=CLIP-ViT-B/32, Bit-width=Full-precision2026.05 | 46 | — | |
| TIES-MergingMerging Strategy=TIES-Merging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 45.1 | — | |
| Simple Averaging + AWQMerging Strategy=Simple Averaging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 43.7 | — | |
| TIES-Merging + AWQMerging Strategy=TIES-Merging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 42.89 | — | |
| TIES-Merging + GPTQMerging Strategy=TIES-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 42.19 | — | |
| TIES-Merging + RTNMerging Strategy=TIES-Merging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 36.85 | — | |
| SigLIPShots=0, Base Model=SigLIP, Adaptation Method=Zero-Shot2026.03 | 35.35 | — | |
| MaPLeShots=1, Backbone=ViT-B/162026.03 | 29.1 | — | |
| Task ArithmeticMerging Strategy=Task Arithmetic, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 25.6 | — | |
| Task Arithmetic + GPTQMerging Strategy=Task Arithmetic, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 23.52 | — | |
| Task Arithmetic + AWQMerging Strategy=Task Arithmetic, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 23.07 | — | |
| Task Arithmetic + RTNMerging Strategy=Task Arithmetic, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 21.07 | — |