Multiple Choice Question (MCQ) on AccidentBench (land)
68.4Accuracy (Short, Easy)MAVEN (+ RL)
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MAVEN (+ RL)Training=SFT+RL2026.05 | 68.4 | 50.3 | 37.7 | 52.1 | 53 | 42.6 | 38.3 | 44.6 | 51 | 35.4 | 21.6 | 36 | 44.2 | |
| MAVEN (+ Dashcam SFT)Training=SFT2026.05 | 66.6 | 46.9 | 30.2 | 47.9 | 47.7 | 42.1 | 35 | 41.6 | 52.6 | 35.2 | 21.3 | 36.4 | 42 | |
| Gemini 3.1 FlashTraining=0-shot2026.05 | 63.1 | 45.1 | 31 | 46.4 | 51.5 | 42.7 | 38.9 | 44.4 | 48 | 40 | 25.3 | 37.8 | 42.8 | |
| Gemini 2.5 ProTraining=0-shot2026.05 | 63 | 42.8 | 34.8 | 46.9 | 54.7 | 33.9 | 35.8 | 41.5 | 46 | 32.7 | 18.7 | 32.5 | 40.3 | |
| MAVEN (+ CCTV SFT)Training=SFT2026.05 | 60.4 | 40.8 | 26.1 | 42.4 | 52.3 | 40.5 | 34.5 | 42.4 | 50.2 | 37.5 | 23 | 36.9 | 40.6 | |
| CR2Training=0-shot2026.05 | 43.6 | 32.4 | 21.3 | 32.4 | 40 | 33 | 29.6 | 34.2 | 30.3 | 24.3 | 14.7 | 23.1 | 29.9 |