List your company
ResearchFormerly WizWand

Data Leakage Detection on Image MLLM Evaluation Set

99.7AUC-ROCFiMMIA
64.44473.59782.7591.903Dec 2, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FiMMIAM_origin=Gemma-3-12b-it, M_test=Gemma-3-12b-it2025.1299.7
FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Gemma-3-12b-it2025.1299.5
FiMMIAM_origin=Gemma-3-4b-it, M_test=Gemma-3-4b-it2025.1299.4
FiMMIAM_origin=Gemma-3-12b-it, M_test=Gemma-3-4b-it2025.1299.4
FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Gemma-3-4b-it2025.1299.1
FiMMIAM_origin=Gemma-3-4b-it, M_test=Gemma-3-12b-it2025.1298.7
FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Qwen2.5-VL-7B-Instruct2025.1298.1
FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Llama3-llava-next-8b-hf2025.1297.7
FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Qwen2.5-VL-7B-Instruct2025.1296.6
FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Qwen2.5-VL-3B-Instruct2025.1296.2
FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Qwen2-VL-7B-Instruct2025.1296.2
FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Llama3-llava-next-8b-hf2025.1295.8
FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Gemma-3-4b-it2025.1295.4
FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Qwen2.5-VL-3B-Instruct2025.1294.6
FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Gemma-3-12b-it2025.1294.5
FiMMIAM_origin=Gemma-3-12b-it, M_test=Llama3-llava-next-8b-hf2025.1293.3
FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Qwen2-VL-7B-Instruct2025.1293.1
FiMMIAM_origin=Qwen2.5-VL-7B-Instruct, M_test=Qwen2.5-VL-3B-Instruct2025.1292.8
FiMMIAM_origin=Gemma-3-12b-it, M_test=Qwen2.5-VL-7B-Instruct2025.1291.2
FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Llama3-llava-next-8b-hf2025.1290.2
FiMMIAM_origin=Llama3-llava-next-8b-hf, M_test=Qwen2-VL-7B-Instruct2025.1290
FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Qwen2.5-VL-7B-Instruct2025.1288
FiMMIAM_origin=Gemma-3-4b-it, M_test=Llama3-llava-next-8b-hf2025.1286.5
FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Qwen2-VL-7B-Instruct2025.1286
FiMMIAM_origin=Gemma-3-4b-it, M_test=Qwen2.5-VL-7B-Instruct2025.1285.2
FiMMIAM_origin=Gemma-3-12b-it, M_test=Qwen2.5-VL-3B-Instruct2025.1284.1
FiMMIAM_origin=Gemma-3-12b-it, M_test=Qwen2-VL-7B-Instruct2025.1281.3
FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Qwen2.5-VL-7B-Instruct2025.1280.5
FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Qwen2.5-VL-3B-Instruct2025.1278
FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Llama3-llava-next-8b-hf2025.1278
FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Gemma-3-4b-it2025.1277.7
FiMMIAM_origin=Gemma-3-4b-it, M_test=Qwen2.5-VL-3B-Instruct2025.1276
FiMMIAM_origin=Qwen2-VL-7B-Instruct, M_test=Gemma-3-12b-it2025.1273.7
FiMMIAM_origin=Gemma-3-4b-it, M_test=Qwen2-VL-7B-Instruct2025.1271.5
FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Gemma-3-12b-it2025.1267.9
FiMMIAM_origin=Qwen2.5-VL-3B-Instruct, M_test=Gemma-3-4b-it2025.1265.8