Data Leakage Detection on Image MLLM Evaluation Set
99.7AUC-ROCFiMMIA
Evaluation Results
| Method | Links | |
|---|---|---|
| FiMMIAM_origin=Gemma-3-12b-it, M_test=Gemma-3-12b-it2025.12 | 99.7 | |
| FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Gemma-3-12b-it2025.12 | 99.5 | |
| FiMMIAM_origin=Gemma-3-4b-it, M_test=Gemma-3-4b-it2025.12 | 99.4 | |
| FiMMIAM_origin=Gemma-3-12b-it, M_test=Gemma-3-4b-it2025.12 | 99.4 | |
| FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Gemma-3-4b-it2025.12 | 99.1 | |
| FiMMIAM_origin=Gemma-3-4b-it, M_test=Gemma-3-12b-it2025.12 | 98.7 | |
| FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Qwen2.5-VL-7B-Instruct2025.12 | 98.1 | |
| FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Llama3-llava-next-8b-hf2025.12 | 97.7 | |
| FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Qwen2.5-VL-7B-Instruct2025.12 | 96.6 | |
| FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Qwen2.5-VL-3B-Instruct2025.12 | 96.2 | |
| FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Qwen2-VL-7B-Instruct2025.12 | 96.2 | |
| FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Llama3-llava-next-8b-hf2025.12 | 95.8 | |
| FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Gemma-3-4b-it2025.12 | 95.4 | |
| FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Qwen2.5-VL-3B-Instruct2025.12 | 94.6 | |
| FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Gemma-3-12b-it2025.12 | 94.5 | |
| FiMMIAM_origin=Gemma-3-12b-it, M_test=Llama3-llava-next-8b-hf2025.12 | 93.3 | |
| FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Qwen2-VL-7B-Instruct2025.12 | 93.1 | |
| FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Qwen2.5-VL-3B-Instruct2025.12 | 92.8 | |
| FiMMIAM_origin=Gemma-3-12b-it, M_test=Qwen2.5-VL-7B-Instruct2025.12 | 91.2 | |
| FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Llama3-llava-next-8b-hf2025.12 | 90.2 | |
| FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Qwen2-VL-7B-Instruct2025.12 | 90 | |
| FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Qwen2.5-VL-7B-Instruct2025.12 | 88 | |
| FiMMIAM_origin=Gemma-3-4b-it, M_test=Llama3-llava-next-8b-hf2025.12 | 86.5 | |
| FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Qwen2-VL-7B-Instruct2025.12 | 86 | |
| FiMMIAM_origin=Gemma-3-4b-it, M_test=Qwen2.5-VL-7B-Instruct2025.12 | 85.2 | |
| FiMMIAM_origin=Gemma-3-12b-it, M_test=Qwen2.5-VL-3B-Instruct2025.12 | 84.1 | |
| FiMMIAM_origin=Gemma-3-12b-it, M_test=Qwen2-VL-7B-Instruct2025.12 | 81.3 | |
| FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Qwen2.5-VL-7B-Instruct2025.12 | 80.5 | |
| FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Qwen2.5-VL-3B-Instruct2025.12 | 78 | |
| FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Llama3-llava-next-8b-hf2025.12 | 78 | |
| FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Gemma-3-4b-it2025.12 | 77.7 | |
| FiMMIAM_origin=Gemma-3-4b-it, M_test=Qwen2.5-VL-3B-Instruct2025.12 | 76 | |
| FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Gemma-3-12b-it2025.12 | 73.7 | |
| FiMMIAM_origin=Gemma-3-4b-it, M_test=Qwen2-VL-7B-Instruct2025.12 | 71.5 | |
| FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Gemma-3-12b-it2025.12 | 67.9 | |
| FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Gemma-3-4b-it2025.12 | 65.8 |