Detection on CareQA-Vision Adversarial (test)
82Base AccuracyAloe-Vision
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Aloe-VisionSize=72B, Stage=S22026.06 | 82 | 31 | 57 | 54.3 | 33.1 | |
| Qwen3-VL-8B-Instruct2026.06 | 81 | 19.5 | 19.7 | 35.7 | 16.4 | |
| Qwen3-VL-30B-A3B-Instruct2026.06 | 81 | 20.8 | 37.1 | 34.3 | 26.2 | |
| GLM-4.5V2026.06 | 80 | 3.8 | 12.6 | 20.2 | 14.4 | |
| Qwen2-VLSize=72B2026.06 | 78.4 | 6.3 | 5.7 | 20.5 | 8.7 | |
| LingshuSize=7B2026.06 | 78.1 | 4.7 | 8.6 | 22.3 | 17.8 | |
| LingshuSize=32B2026.06 | 77.7 | 7.8 | 12.6 | 34.8 | 22.7 | |
| Aloe-VisionSize=7B, Stage=S22026.06 | 76.9 | 75.3 | 58.5 | 68.6 | 58 | |
| Kimi-VL-A3B-Instruct2026.06 | 75.8 | 4.2 | 7.4 | 10 | 21.1 | |
| Hulu-MedSize=32B2026.06 | 73.3 | 3 | 8.2 | 21.8 | 15.3 | |
| Aloe-VisionSize=72B, Stage=S12026.06 | 72.5 | 4 | 2.9 | 19.7 | 9.4 | |
| GPT-5.22026.06 | 70.9 | 14.3 | 5.3 | 9.7 | 8.7 | |
| Aloe-VisionSize=7B, Stage=S12026.06 | 69.1 | 66.4 | 10.3 | 26.3 | 34.4 | |
| Hulu-MedSize=7B2026.06 | 68.9 | 1.8 | 0.1 | 5 | 26.3 | |
| Qwen2-VLSize=7B2026.06 | 65.1 | 16.5 | 8.5 | 17.6 | 22.6 | |
| MiMo-VLSize=7B2026.06 | 63.9 | 0.9 | 1.5 | 8.9 | 2.3 | |
| Chiron-o1Size=8B2026.06 | 57.4 | 19.2 | 8.6 | 33.3 | 24.4 | |
| HuatuoGPT-VisionSize=34B2026.06 | 55.9 | 25.6 | 2.3 | 6.3 | 36.6 | |
| HuatuoGPT-VisionSize=7B2026.06 | 51.9 | 25.5 | 0.7 | 5.2 | 41.6 | |
| Random2026.06 | 25 | — | — | 25 | — |