Compositional Privacy Risk Evaluation on CPRT 1.0 (test) benchmark leaderboard · SOTA2 Research

Compositional Privacy Risk Evaluation on CPRT 1.0 (test)

0.884Pearson CorrelationGemini 3 Flash

Evaluation Results

Method	Links
Gemini 3 Flash2026.03		0.884	0.872	0.14	0.009	70.3	93.8	86.2
GPT-5.22026.03		0.85	0.844	0.158	-0.046	63.2	91.9	80.5
Qwen3-VL (8B)2026.03		0.799	0.762	0.14	0.061	63.3	84.9	74.5
Gemini 3 Flash2026.03		0.781	0.802	0.203	-0.166	40.3	84.8	66.2
GPT-5.22026.03		0.77	0.809	0.225	-0.197	31.6	88.4	64.5
Gemini 3 Flash2026.03		0.752	0.792	0.244	-0.22	30.2	85.7	63.9
GPT-5.22026.03		0.733	0.798	0.257	-0.23	28.1	87.8	66.7
Llama 4 Maverick2026.03		0.728	0.763	0.233	-0.199	38.7	85.7	58.8
Qwen3-VL (32B)2026.03		0.726	0.753	0.224	-0.181	41.6	85.2	57.2
Llama 4 Maverick2026.03		0.719	0.762	0.278	-0.264	28.4	84.8	67.5
Llama 4 Maverick2026.03		0.673	0.695	0.255	-0.231	38.4	80.6	53.7
Qwen3-VL (8B)2026.03		0.636	0.751	0.291	-0.263	31.4	80.8	64.9
Pixtral (12B)2026.03		0.622	0.716	0.286	-0.253	30.8	81.2	62.9
Qwen3-VL (32B)2026.03		0.616	0.724	0.299	-0.269	29.8	81.5	67.9
MiniCPM-V (8B)2026.03		0.616	0.61	0.237	-0.16	31.1	74.9	54
Pixtral (12B)2026.03		0.616	0.72	0.311	-0.29	29.3	80.2	65.8
Qwen3-VL (32B)2026.03		0.603	0.724	0.292	-0.25	31.5	82.7	63.3
Pixtral (12B)2026.03		0.595	0.691	0.279	-0.234	38.1	78.9	53.8
Qwen3-VL (8B)2026.03		0.558	0.678	0.331	-0.311	29.6	80.7	68.4
MiniCPM-V (8B)2026.03		0.509	0.566	0.305	-0.247	27.4	72.1	44.4
MiniCPM-V (8B)2026.03		0.476	0.526	0.326	-0.252	37.1	71.4	41.8
Llama 3.2-VL (11B)2026.03		0.46	0.571	0.344	-0.304	29.9	72.9	47.8
Qwen3-VL (8B)2026.03		0.377	0.383	0.389	-0.37	29	66.5	57.5
Llama 3.2-VL (11B)2026.03		0.307	0.354	0.349	-0.253	29.5	62.9	36.4
Llama 3.2-VL (11B)2026.03		0.267	0.339	0.345	-0.206	29.8	64.6	38.8