Image Classification on GTSRB (Top-1 Accuracy)
98.9Top-1 AccuracyFine-tuned (STL)
Evaluation Results
| Method | Links | |
|---|---|---|
| Fine-tuned (STL)Backbone=CLIP-ViT-B/32, Bit-width=Full-precision, Training=Single-task learning2026.05 | 98.9 | |
| WUDI-MergingMerging Method=WUDI-Merging, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 98 | |
| WUDI-MergingBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Bit-width=Full-precision2026.05 | 94.9 | |
| WUDI-MergingMerging Strategy=WUDI-Merging, Quantization Method=None, Model Backbone=CLIP-ViT-B/32, Bit-width=Full2026.05 | 91.5 | |
| WUDI-Merging w/ E-PMQMerging Method=WUDI-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 88.9 | |
| WUDI-Merging w/ GPTQMerging Method=WUDI-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 88.4 | |
| WUDI-Merging w/ RTNMerging Method=WUDI-Merging, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 88.2 | |
| TIES-MergingMerging Method=TIES-Merging, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 85.2 | |
| WUDI-Merging w/ AWQMerging Method=WUDI-Merging, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 84.3 | |
| Task ArithmeticMerging Method=Task Arithmetic, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 83.5 | |
| WUDI-MergingMerging Strategy=WUDI-Merging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 82.9 | |
| WUDI-Merging w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=GPTQ, Bit-width=4-bit2026.05 | 81.3 | |
| WUDI-Merging w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=E-PMQ, Bit-width=4-bit2026.05 | 80.6 | |
| WUDI-Merging w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=AWQ, Bit-width=4-bit2026.05 | 80.2 | |
| WUDI-Merging w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=WUDI-Merging, Quantization Algorithm=RTN, Bit-width=4-bit2026.05 | 80 | |
| WUDI-Merging w/ GPTQMerging Strategy=WUDI-Merging, Quantization Method=GPTQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 77.57 | |
| WUDI-Merging w/ AWQMerging Strategy=WUDI-Merging, Quantization Method=AWQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 77.09 | |
| Simple Averaging w/ E-PMQMerging Method=Simple Averaging, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 76.8 | |
| Task Arithmetic w/ E-PMQMerging Method=Task Arithmetic, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 76.5 | |
| TIES-Merging w/ E-PMQMerging Method=TIES-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 76.4 | |
| TIES-Merging w/ RTNMerging Method=TIES-Merging, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 76.3 | |
| WUDI-Merging w/ E-PMQMerging Strategy=WUDI-Merging, Quantization Method=E-PMQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 76.18 | |
| WUDI-Merging w/ RTNMerging Strategy=WUDI-Merging, Quantization Method=RTN, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 76.03 | |
| TIES-Merging w/ GPTQMerging Method=TIES-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 75.9 | |
| Simple AveragingMerging Method=Simple Averaging, Quantization Method=None, Bit-width=Full-precision, Model Backbone=CLIP-ViT-L/142026.05 | 74 | |
| WUDI-Merging + E-PMQMerging Strategy=WUDI-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 73.9 | |
| Task Arithmetic w/ GPTQMerging Method=Task Arithmetic, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 73.2 | |
| Task Arithmetic w/ RTNMerging Method=Task Arithmetic, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 72.7 | |
| WUDI-Merging + GPTQMerging Strategy=WUDI-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 71.84 | |
| WUDI-Merging + AWQMerging Strategy=WUDI-Merging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 69.96 | |
| WUDI-Merging + RTNMerging Strategy=WUDI-Merging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 69.52 | |
| TIES-MergingBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Bit-width=Full-precision, Lambda=0.32026.05 | 69.4 | |
| Simple Averaging w/ GPTQMerging Method=Simple Averaging, Quantization Method=GPTQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 69 | |
| Simple Averaging w/ RTNMerging Method=Simple Averaging, Quantization Method=RTN, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 68.8 | |
| Task ArithmeticBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Bit-width=Full-precision, Lambda=0.32026.05 | 68.5 | |
| TIES-MergingMerging Strategy=TIES-Merging, Quantization Method=None, Model Backbone=CLIP-ViT-B/32, Bit-width=Full2026.05 | 63.9 | |
| TIES-Merging w/ AWQMerging Method=TIES-Merging, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 63.5 | |
| TIES-Merging w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=GPTQ, Bit-width=4-bit, Lambda=0.32026.05 | 62.9 | |
| DINORANKCLIPProtocol=Linear probing2026.05 | 62.1 | |
| RANKCLIPProtocol=Linear probing2026.05 | 60.6 | |
| CLIPProtocol=Linear probing2026.05 | 60 | |
| TIES-Merging w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=RTN, Bit-width=4-bit, Lambda=0.32026.05 | 59.8 | |
| Simple Averaging w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=E-PMQ, Bit-width=4-bit2026.05 | 59.5 | |
| TIES-Merging w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=AWQ, Bit-width=4-bit, Lambda=0.32026.05 | 59.3 | |
| TIES-Merging w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=TIES-Merging, Quantization Algorithm=E-PMQ, Bit-width=4-bit, Lambda=0.32026.05 | 59.2 | |
| Task Arithmetic w/ AWQMerging Method=Task Arithmetic, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 58.8 | |
| CyCLIPProtocol=Linear probing2026.05 | 58.6 | |
| TIES-Merging w/ GPTQMerging Strategy=TIES-Merging, Quantization Method=GPTQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 57.85 | |
| TIES-MergingMerging Strategy=TIES-Merging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 57.7 | |
| TIES-Merging w/ RTNMerging Strategy=TIES-Merging, Quantization Method=RTN, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 57.24 | |
| Task Arithmetic w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=GPTQ, Bit-width=4-bit, Lambda=0.32026.05 | 57 | |
| Task Arithmetic w/ E-PMQBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=E-PMQ, Bit-width=4-bit, Lambda=0.32026.05 | 57 | |
| TIES-Merging w/ AWQMerging Strategy=TIES-Merging, Quantization Method=AWQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 56.48 | |
| Task Arithmetic w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=AWQ, Bit-width=4-bit, Lambda=0.32026.05 | 55.6 | |
| ITOPre-training Dataset=DataComp-1B, Backbone=ViT-B/16, Training Epochs=10 epochs, Zero-shot protocol=EVA-CLIP2026.03 | 55.5 | |
| Simple AveragingBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Bit-width=Full-precision2026.05 | 54.9 | |
| Task Arithmetic w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=Task Arithmetic, Quantization Algorithm=RTN, Bit-width=4-bit, Lambda=0.32026.05 | 54.6 | |
| Simple Averaging w/ E-PMQMerging Strategy=Simple Averaging, Quantization Method=E-PMQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 54.32 | |
| CLIPPre-training Dataset=DataComp-1B, Backbone=ViT-B/16, Training Epochs=10 epochs, Zero-shot protocol=EVA-CLIP2026.03 | 54.1 | |
| Simple Averaging + E-PMQMerging Strategy=Simple Averaging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 53.44 | |
| TIES-Merging w/ E-PMQMerging Strategy=TIES-Merging, Quantization Method=E-PMQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 53.36 | |
| Simple Averaging w/ AWQMerging Method=Simple Averaging, Quantization Method=AWQ, Bit-width=4-bit, Model Backbone=CLIP-ViT-L/142026.05 | 52.3 | |
| CLIPBackbone=ViT-L/16, Pre-training Dataset=DataComp-1B, Training Epochs=1, Evaluation Protocol=Zero-shot2026.03 | 52.1 | |
| ALIPProtocol=Linear probing2026.05 | 51.5 | |
| Task Arithmetic w/ E-PMQMerging Strategy=Task Arithmetic, Quantization Method=E-PMQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 51.5 | |
| TIES-Merging + E-PMQMerging Strategy=TIES-Merging, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 51.37 | |
| TIES-Merging + GPTQMerging Strategy=TIES-Merging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 50.53 | |
| TIES-Merging + AWQMerging Strategy=TIES-Merging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 49.74 | |
| Simple Averaging w/ AWQBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=AWQ, Bit-width=4-bit2026.05 | 49.6 | |
| Simple Averaging w/ GPTQBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=GPTQ, Bit-width=4-bit2026.05 | 49.1 | |
| ITOBackbone=ViT-L/16, Pre-training Dataset=DataComp-1B, Training Epochs=1, Evaluation Protocol=Zero-shot2026.03 | 49 | |
| Task ArithmeticMerging Strategy=Task Arithmetic, Quantization Method=None, Model Backbone=CLIP-ViT-B/32, Bit-width=Full2026.05 | 48.4 | |
| TIES-Merging + RTNMerging Strategy=TIES-Merging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 47.81 | |
| Simple Averaging w/ RTNBackbone=CLIP-ViT-B/32, Merging Strategy=Simple Averaging, Quantization Algorithm=RTN, Bit-width=4-bit2026.05 | 47.7 | |
| ITO sub2Backbone=ViT-L/16, Pre-training Dataset=DataComp-1B, Training Epochs=1, Evaluation Protocol=Zero-shot2026.03 | 47.3 | |
| Task Arithmetic + E-PMQMerging Strategy=Task Arithmetic, Quantization Method=E-PMQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 46.66 | |
| ITO sub2Pre-training Dataset=DataComp-1B, Backbone=ViT-B/16, Training Epochs=10 epochs, Zero-shot protocol=EVA-CLIP2026.03 | 45.9 | |
| Simple AveragingMerging Strategy=Simple Averaging, Quantization Method=None, Model Backbone=CLIP-ViT-B/32, Bit-width=Full2026.05 | 45.6 | |
| Task Arithmetic w/ GPTQMerging Strategy=Task Arithmetic, Quantization Method=GPTQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 44.19 | |
| Simple Averaging w/ GPTQMerging Strategy=Simple Averaging, Quantization Method=GPTQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 44.17 | |
| Simple Averaging w/ AWQMerging Strategy=Simple Averaging, Quantization Method=AWQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 43.95 | |
| Simple AveragingMerging Strategy=Simple Averaging, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 43.1 | |
| Simple Averaging + GPTQMerging Strategy=Simple Averaging, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 42.76 | |
| Simple Averaging w/ RTNMerging Strategy=Simple Averaging, Quantization Method=RTN, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 42.64 | |
| Simple Averaging + AWQMerging Strategy=Simple Averaging, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 42.42 | |
| Task Arithmetic w/ RTNMerging Strategy=Task Arithmetic, Quantization Method=RTN, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 41.37 | |
| Task Arithmetic w/ AWQMerging Strategy=Task Arithmetic, Quantization Method=AWQ, Model Backbone=CLIP-ViT-B/32, Bit-width=4-bit2026.05 | 40.91 | |
| ITOZero-shot=true, Backbone=ViT-B/16, Pre-training Dataset=Laion100M, Epochs=302026.03 | 40.7 | |
| Simple Averaging + RTNMerging Strategy=Simple Averaging, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 40.59 | |
| CLIPZero-shot=true, Backbone=ViT-B/16, Pre-training Dataset=Laion100M, Epochs=302026.03 | 38.2 | |
| SLIPZero-shot=true, Backbone=ViT-B/16, Pre-training Dataset=Laion100M, Epochs=302026.03 | 35.5 | |
| Pre-trainedBackbone=CLIP-ViT-B/32, Bit-width=Full-precision2026.05 | 32.5 | |
| Task ArithmeticMerging Strategy=Task Arithmetic, Quantization Method=Full-precision, Bit-width=Full, Backbone=CLIP-ViT-B/322026.05 | 29.8 | |
| Task Arithmetic + AWQMerging Strategy=Task Arithmetic, Quantization Method=AWQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 27.58 | |
| Task Arithmetic + RTNMerging Strategy=Task Arithmetic, Quantization Method=RTN, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 27.51 | |
| Task Arithmetic + GPTQMerging Strategy=Task Arithmetic, Quantization Method=GPTQ, Bit-width=4-bit, Backbone=CLIP-ViT-B/322026.05 | 27.19 | |
| ITO sub2Pre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 13.1 | |
| CLIPPre-training Dataset=CC12M, Backbone=ViT-B/16, Epochs=30, Evaluation protocol=Zero-shot2026.03 | 12.9 | |
| ITO sub2Backbone=ViT-B/16, Pre-training Dataset=CC3M-recap, Evaluation Protocol=Zero-shot2026.03 | 11.9 | |
| FLAIRBackbone=ViT-B/16, Pre-training Dataset=CC3M-recap, Evaluation Protocol=Zero-shot2026.03 | 11.4 |