Vision Classification on 8-Task Suite (CLIP ViT-B-32, test)
89.9Accuracy (%)Experts
Evaluation results
| Method | Links | |
|---|---|---|
| ExpertsFine-tuning Style=FFT, Training Condition=2048 steps2025.06 | 89.9 | |
| ExpertsFine-tuning Style=FFT, Training Condition=Early stop2025.06 | 87.9 | |
| ExpertsFine-tuning Style=LoRA, Training Condition=Early stop2025.06 | 87.9 | |
| ExpertsFine-tuning Style=LoRA, Training Condition=2048 steps2025.06 | 87.6 | |
| TIESFine-tuning Style=FFT, Training Condition=Best (# steps)2025.06 | 75.8 | |
| TIESFine-tuning Style=FFT, Training Condition=Early stop2025.06 | 74.7 | |
| TIESFine-tuning Style=FFT, Training Condition=2048 steps2025.06 | 73.8 | |
| Task ArithmeticFine-tuning Style=FFT, Training Condition=Best (# steps)2025.06 | 72.7 | |
| DAREFine-tuning Style=FFT, Training Condition=Best (# steps)2025.06 | 72.6 | |
| Task ArithmeticFine-tuning Style=FFT, Training Condition=Early stop2025.06 | 72.6 | |
| DAREFine-tuning Style=FFT, Training Condition=Early stop2025.06 | 72.5 | |
| Task ArithmeticFine-tuning Style=FFT, Training Condition=2048 steps2025.06 | 69.8 | |
| DAREFine-tuning Style=FFT, Training Condition=2048 steps2025.06 | 69.6 | |
| Task ArithmeticFine-tuning Style=LoRA, Training Condition=Early stop2025.06 | 68 | |
| TIESFine-tuning Style=LoRA, Training Condition=Early stop2025.06 | 67.1 | |
| Task ArithmeticFine-tuning Style=LoRA, Training Condition=Best (# steps)2025.06 | 67 | |
| TIESFine-tuning Style=LoRA, Training Condition=Best (# steps)2025.06 | 66.9 | |
| AverageFine-tuning Style=FFT, Training Condition=2048 steps2025.06 | 65.9 | |
| AverageFine-tuning Style=FFT, Training Condition=Best (# steps)2025.06 | 65.9 | |
| AverageFine-tuning Style=LoRA, Training Condition=Early stop2025.06 | 65.6 | |
| AverageFine-tuning Style=LoRA, Training Condition=Best (# steps)2025.06 | 65.4 | |
| DAREFine-tuning Style=LoRA, Training Condition=Early stop2025.06 | 65.3 | |
| DAREFine-tuning Style=LoRA, Training Condition=Best (# steps)2025.06 | 64.7 | |
| AverageFine-tuning Style=FFT, Training Condition=Early stop2025.06 | 64.5 | |
| Task ArithmeticFine-tuning Style=LoRA, Training Condition=2048 steps2025.06 | 61.1 | |
| AverageFine-tuning Style=LoRA, Training Condition=2048 steps2025.06 | 60.3 | |
| DAREFine-tuning Style=LoRA, Training Condition=2048 steps2025.06 | 58.8 | |
| TIESFine-tuning Style=LoRA, Training Condition=2048 steps2025.06 | 50.7 |