Video Anomaly Classification on SmartHome-LLM
88.27AccuracyDeepIntuit
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DeepIntuitModel=Qwen2.5-VL-7B, Open=✓2026.03 | 88.27 | 83.45 | 90.91 | 87.18 | |
| RB-FTModel=Qwen2.5-VL-7B, Open=✓2026.03 | 82.65 | 76.06 | 86.4 | 81.23 | |
| Direct-SFTModel=Qwen2.5-VL-7B, Open=✓2026.03 | 76.02 | 51.55 | 84.07 | 67.81 | |
| Gemini-2.5-ProModel=Gemini, Open=✓2026.03 | 73.47 | 70.11 | 76.15 | 73.13 | |
| Gemini-2.5-FlashModel=Gemini, Open=✓2026.03 | 73.33 | 70.79 | 75.47 | 73.13 | |
| GPT-4VModel=GPT, Open=✓2026.03 | 70.53 | 69.23 | 71.72 | 70.48 | |
| UniFormerV2Model=Video Encoder, Open=×2026.03 | 70.12 | 38.02 | 78.95 | 58.49 | |
| InternVideo2-6BModel=Video Encoder, Open=×2026.03 | 68.7 | 35.4 | 79.1 | 57.25 | |
| GPT-4oModel=GPT, Open=✓2026.03 | 62.76 | 63.32 | 62.18 | 62.75 | |
| Zero-shotModel=Qwen2.5-VL-7B, Open=✓2026.03 | 55.1 | 60.36 | 48.24 | 54.3 |