Compositional Privacy Risk Evaluation on CPRT 1.0 (test)
0.884Pearson CorrelationGemini 3 Flash
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gemini 3 FlashPrompting=Taxonomy2026.03 | 0.884 | 0.872 | 0.14 | 0.009 | 70.3 | 93.8 | 86.2 | |
| GPT-5.2Prompting=Taxonomy2026.03 | 0.85 | 0.844 | 0.158 | -0.046 | 63.2 | 91.9 | 80.5 | |
| Qwen3-VL (8B)Prompting=Taxonomy, SFT=true2026.03 | 0.799 | 0.762 | 0.14 | 0.061 | 63.3 | 84.9 | 74.5 | |
| Gemini 3 FlashPrompting=Zero-Shot2026.03 | 0.781 | 0.802 | 0.203 | -0.166 | 40.3 | 84.8 | 66.2 | |
| GPT-5.2Prompting=Zero-Shot2026.03 | 0.77 | 0.809 | 0.225 | -0.197 | 31.6 | 88.4 | 64.5 | |
| Gemini 3 FlashPrompting=Intuition2026.03 | 0.752 | 0.792 | 0.244 | -0.22 | 30.2 | 85.7 | 63.9 | |
| GPT-5.2Prompting=Intuition2026.03 | 0.733 | 0.798 | 0.257 | -0.23 | 28.1 | 87.8 | 66.7 | |
| Llama 4 MaverickPrompting=Taxonomy2026.03 | 0.728 | 0.763 | 0.233 | -0.199 | 38.7 | 85.7 | 58.8 | |
| Qwen3-VL (32B)Prompting=Taxonomy2026.03 | 0.726 | 0.753 | 0.224 | -0.181 | 41.6 | 85.2 | 57.2 | |
| Llama 4 MaverickPrompting=Intuition2026.03 | 0.719 | 0.762 | 0.278 | -0.264 | 28.4 | 84.8 | 67.5 | |
| Llama 4 MaverickPrompting=Zero-Shot2026.03 | 0.673 | 0.695 | 0.255 | -0.231 | 38.4 | 80.6 | 53.7 | |
| Qwen3-VL (8B)Prompting=Taxonomy2026.03 | 0.636 | 0.751 | 0.291 | -0.263 | 31.4 | 80.8 | 64.9 | |
| Pixtral (12B)Prompting=Intuition2026.03 | 0.622 | 0.716 | 0.286 | -0.253 | 30.8 | 81.2 | 62.9 | |
| Qwen3-VL (32B)Prompting=Intuition2026.03 | 0.616 | 0.724 | 0.299 | -0.269 | 29.8 | 81.5 | 67.9 | |
| MiniCPM-V (8B)Prompting=Intuition2026.03 | 0.616 | 0.61 | 0.237 | -0.16 | 31.1 | 74.9 | 54 | |
| Pixtral (12B)Prompting=Taxonomy2026.03 | 0.616 | 0.72 | 0.311 | -0.29 | 29.3 | 80.2 | 65.8 | |
| Qwen3-VL (32B)Prompting=Zero-Shot2026.03 | 0.603 | 0.724 | 0.292 | -0.25 | 31.5 | 82.7 | 63.3 | |
| Pixtral (12B)Prompting=Zero-Shot2026.03 | 0.595 | 0.691 | 0.279 | -0.234 | 38.1 | 78.9 | 53.8 | |
| Qwen3-VL (8B)Prompting=Intuition2026.03 | 0.558 | 0.678 | 0.331 | -0.311 | 29.6 | 80.7 | 68.4 | |
| MiniCPM-V (8B)Prompting=Zero-Shot2026.03 | 0.509 | 0.566 | 0.305 | -0.247 | 27.4 | 72.1 | 44.4 | |
| MiniCPM-V (8B)Prompting=Taxonomy2026.03 | 0.476 | 0.526 | 0.326 | -0.252 | 37.1 | 71.4 | 41.8 | |
| Llama 3.2-VL (11B)Prompting=Intuition2026.03 | 0.46 | 0.571 | 0.344 | -0.304 | 29.9 | 72.9 | 47.8 | |
| Qwen3-VL (8B)Prompting=Zero-Shot2026.03 | 0.377 | 0.383 | 0.389 | -0.37 | 29 | 66.5 | 57.5 | |
| Llama 3.2-VL (11B)Prompting=Taxonomy2026.03 | 0.307 | 0.354 | 0.349 | -0.253 | 29.5 | 62.9 | 36.4 | |
| Llama 3.2-VL (11B)Prompting=Zero-Shot2026.03 | 0.267 | 0.339 | 0.345 | -0.206 | 29.8 | 64.6 | 38.8 |