Visual Understanding on VQAv2, NLVR2, MME (held-out)
71.54AccuracySKILLRATER
Evaluation results
| Method | Links | |
|---|---|---|
| SKILLRATERTraining Steps=100k, Model Scale=2B, Training Recipe=Isaac 0.2, Rater Parameters=150M, Rater Configuration=capability-specific2026.02 | 71.54 | |
| SKILLRATER CombinedTraining Steps=100k, Model Scale=2B, Training Recipe=Isaac 0.2, Rater Parameters=150M, Rater Configuration=pooled-validation2026.02 | 71.36 | |
| DataRaterTraining Steps=100k, Model Scale=2B, Training Recipe=Isaac 0.2, Rater Parameters=150M, Rater Configuration=monolithic2026.02 | 68.33 | |
| Mammoth (Baseline)Training Steps=100k, Model Scale=2B, Training Recipe=Isaac 0.2, Training Dataset=Mammoth2026.02 | 65.91 |