Semantic Anomaly Detection on SAVANT
94AccuracyQwen2.5-VL-7B (FT)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-VL-7B (FT)Evaluation protocol=Fine-Tuned (FT), Inference time (s)=0.08, Output tokens=2, Number of queries=12025.10 | 94 | 91 | 97 | 94 | |
| Gemini-2.0-FE (full_opt)Evaluation protocol=Full optimized (full_opt), Inference time (s)=17.8, Output tokens=791, Number of queries=52025.10 | 88 | 90 | 86 | 88 | |
| Qwen2.5-VL-7B (PFT)Evaluation protocol=Pipeline Fine-Tuned (PFT), Inference time (s)=13.85, Output tokens=788, Number of queries=22025.10 | 84 | 82 | 85 | 83 | |
| Qwen2.5-VL-7B (NFT)Evaluation protocol=Non-Fine-Tuned (NFT), Inference time (s)=1.74, Output tokens=105, Number of queries=12025.10 | 55 | 48 | 55 | 52 |