Multi-modal Understanding on MME
90.85M(cl, nc)Vanilla Attack
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Vanilla AttackModel=Qwen-VL, Attack Type=Vanilla, Compression=PDrop2026.01 | 90.85 | 81.7 | 21.15 | 37.18 | 23.28 | 54.49 | -0.2223 | |
| Random AttackModel=Qwen-VL, Attack Type=Random, Compression=PDrop2026.01 | 90.85 | 81.7 | 89.54 | 80.36 | 98.56 | 1.64 | 0.002 | |
| CAAModel=Qwen-VL, Attack Type=Compression-Aware, Compression=PDrop2026.01 | 90.85 | 81.7 | 73.14 | 40.42 | 80.51 | 50.53 | 0.3103 | |
| Vanilla AttackModel=LLaVA, Attack Type=Vanilla, Compression=PDrop2026.01 | 87.14 | 79.1 | 47.13 | 43.95 | 54.09 | 44.44 | -0.0148 | |
| Random AttackModel=LLaVA, Attack Type=Random, Compression=PDrop2026.01 | 87.14 | 79.1 | 84.89 | 76.9 | 97.42 | 2.78 | 0.002 | |
| CAAModel=LLaVA, Attack Type=Compression-Aware, Compression=PDrop2026.01 | 87.14 | 79.1 | 83.28 | 38.26 | 95.79 | 51.63 | 0.472 | |
| Vanilla AttackModel=LLaVA-NEXT, Attack Type=Vanilla, Compression=PDrop2026.01 | 86.17 | 82.96 | 44.59 | 42.68 | 51.75 | 48.55 | 0.003 | |
| Random AttackModel=LLaVA-NEXT, Attack Type=Random, Compression=PDrop2026.01 | 86.17 | 82.96 | 84.24 | 80.99 | 97.76 | 2.37 | 0.0013 | |
| CAAModel=LLaVA-NEXT, Attack Type=Compression-Aware, Compression=PDrop2026.01 | 86.17 | 82.96 | 83.6 | 54.81 | 97.02 | 33.93 | 0.3095 |