Agent Decision Making on 50-storefront golden set skimmers cohort (overall)
77Alignment (%)Gemini 3 Flash
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gemini 3 FlashInput Modality=Visual, Runtime/shop=5.3 min2026.05 | 77 | 66 | 0.55 | 0.32 | |
| Gemini 3 Flash (text only)Input Modality=Text-only, Runtime/shop=4.5 min2026.05 | 70 | 58 | 0.49 | 0.25 | |
| GPT-OSS (text only)Input Modality=Text-only, Runtime/shop=12.8 min2026.05 | 59 | 47 | 0.41 | 0.15 |