Mirage Detection on VQA Mirage Detection Chest, Pathology, Natural, Document, Infographic (test)
2.7Mirage RateTC-LIA + Ensemble
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TC-LIA + EnsembleVLM Backbone=LLaMA-3.2-90B, Detection Configuration=TC-LIA + Ensemble2026.05 | 2.7 | 94.1 | 94.1 | |
| TC-LIA + EnsembleVLM Backbone=Qwen2.5-VL-72B, Detection Configuration=TC-LIA + Ensemble2026.05 | 2.8 | 94.6 | 94.6 | |
| TC-LIA + EnsembleVLM Backbone=InternVL3-38B, Detection Configuration=TC-LIA + Ensemble2026.05 | 2.8 | 91.4 | 91.4 | |
| TC-LIA + EnsembleVLM Backbone=Qwen2.5-VL-32B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3 | 94.7 | 94.7 | |
| TC-LIA + EnsembleVLM Backbone=LLaVA-Next-110B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3 | 92 | 92 | |
| TC-LIA + EnsembleVLM Backbone=Phi-3.5-Vision, Detection Configuration=TC-LIA + Ensemble2026.05 | 3 | 91 | 91 | |
| TC-LIA + EnsembleVLM Backbone=BLIP2-2.7B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3 | 91 | 91 | |
| TC-LIA + EnsembleVLM Backbone=Gemma3-4B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3.1 | 92.8 | 92.8 | |
| TC-LIA + EnsembleVLM Backbone=MiniCPM-V-2.6, Detection Configuration=TC-LIA + Ensemble2026.05 | 3.1 | 91.1 | 91 | |
| TC-LIA + EnsembleVLM Backbone=Aya-Vision-32B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3.2 | 93.9 | 93.9 | |
| TC-LIA + EnsembleVLM Backbone=Qwen2.5-VL-7B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3.2 | 93.7 | 93.7 | |
| TC-LIA + EnsembleVLM Backbone=LLaVA-v1.6-34B, Detection Configuration=TC-LIA + Ensemble2026.05 | 3.3 | 92 | 92 | |
| TC-LIAVLM Backbone=Qwen2.5-VL-32B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=Qwen2.5-VL-72B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=LLaMA-3.2-90B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=Aya-Vision-32B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=Qwen2.5-VL-7B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=Gemma3-4B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=LLaVA-v1.6-34B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=LLaVA-Next-110B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=InternVL3-38B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=MiniCPM-V-2.6, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=Phi-3.5-Vision, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| TC-LIAVLM Backbone=BLIP2-2.7B, Detection Configuration=TC-LIA Only2026.05 | 3.4 | 90.6 | — | |
| Aya-Vision-32BDetection Configuration=Base2026.05 | 21.7 | — | — | |
| LLaVA-v1.6-34BDetection Configuration=Base2026.05 | 24.9 | — | — | |
| LLaMA-3.2-90BDetection Configuration=Base2026.05 | 26 | — | — | |
| InternVL3-38BDetection Configuration=Base2026.05 | 27.1 | — | — | |
| Qwen2.5-VL-32BDetection Configuration=Base2026.05 | 57.4 | — | — | |
| BLIP2-2.7BDetection Configuration=Base2026.05 | 58 | — | — | |
| Gemma3-4BDetection Configuration=Base2026.05 | 58.8 | — | — | |
| Phi-3.5-VisionDetection Configuration=Base2026.05 | 61.9 | — | — | |
| Qwen2.5-VL-72BDetection Configuration=Base2026.05 | 63.6 | — | — | |
| Qwen2.5-VL-7BDetection Configuration=Base2026.05 | 63.6 | — | — | |
| LLaVA-Next-110BDetection Configuration=Base2026.05 | 63.6 | — | — | |
| MiniCPM-V-2.6Detection Configuration=Base2026.05 | 66.6 | — | — |