Image Classification on ImageNet OOD (Avg of V2, R, Sketch, A, and ObjectNet) 1.0 (test)
51.6Top-1 AccMonoSoup
Evaluation results
| Method | Links | |
|---|---|---|
| MonoSoupModel Variant=OOD+, Merging Hyperparameter (R)=0.8, Cost (Checkpoints)=12026.02 | 51.6 | |
| Uniform Model SoupCost (Checkpoints)=702026.02 | 51.4 | |
| MonoSoupModel Pair Selection=ID+, OOD+, Cost (Checkpoints)=22026.02 | 51.37 | |
| MonoSoupModel Variant=OOD+, Merging Hyperparameter (R)=Automated, Cost (Checkpoints)=12026.02 | 50.91 | |
| Greedy Model SoupCost (Checkpoints)=702026.02 | 50.7 | |
| FT model (OOD+)2026.02 | 50.67 | |
| ModelStockModel Pair Selection=ID+, OOD+, Cost (Checkpoints)=22026.02 | 50.53 | |
| MonoSoupModel Variant=ID+, Merging Hyperparameter (R)=0.8, Cost (Checkpoints)=12026.02 | 49.95 | |
| MonoSoupModel Variant=ID+, Merging Hyperparameter (R)=Automated, Cost (Checkpoints)=12026.02 | 48.94 | |
| FT model (ID+)2026.02 | 47.96 | |
| MonoSoupModel Variant=ID-, Merging Hyperparameter (R)=0.8, Cost (Checkpoints)=12026.02 | 46.54 | |
| Initialization2026.02 | 46.2 | |
| MonoSoupModel Variant=ID-, Merging Hyperparameter (R)=Automated, Cost (Checkpoints)=12026.02 | 45.22 | |
| MonoSoupModel Variant=OOD-, Merging Hyperparameter (R)=0.8, Cost (Checkpoints)=12026.02 | 44.21 | |
| MonoSoupModel Variant=OOD-, Merging Hyperparameter (R)=Automated, Cost (Checkpoints)=12026.02 | 42.78 | |
| FT model (ID-)2026.02 | 38.64 | |
| FT model (OOD-)2026.02 | 36.71 |