Mutual Information Estimation on Synthetic Independent
0.11PMI Score (ρ)PMIScore
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PMIScoreModel=Phi-4-mini-instruct2026.03 | 0.11 | 0.255 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-1.7B2026.03 | 0.076 | 0.252 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-8B2026.03 | 0.068 | 0.253 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-4B2026.03 | 0.046 | 0.256 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Llama-3.2-3B-Instruct2026.03 | 0.039 | 0.252 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-0.6B2026.03 | 0.018 | 0.228 | — | — | — | — | — | — | — | — | |
| InfoNCEModel=Phi-4-mini-instruct2026.03 | — | — | — | — | 0.079 | 5.817 | — | — | — | — | |
| InfoNCEModel=Qwen3-0.6B2026.03 | — | — | — | — | 0.034 | 23.007 | — | — | — | — | |
| InfoNCEModel=Qwen3-1.7B2026.03 | — | — | — | — | 0.045 | 7.844 | — | — | — | — | |
| InfoNCEModel=Qwen3-4B2026.03 | — | — | — | — | 0.033 | 3.188 | — | — | — | — | |
| InfoNCEModel=Qwen3-8B2026.03 | — | — | — | — | 0.015 | 3.545 | — | — | — | — | |
| InfoNCEModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | 0.036 | 3.571 | — | — | — | — | |
| KDEModel=Phi-4-mini-instruct2026.03 | — | — | — | — | — | — | 0.014 | 3.334 | — | — | |
| KDEModel=Qwen3-0.6B2026.03 | — | — | — | — | — | — | 0.021 | 1.479 | — | — | |
| KDEModel=Qwen3-1.7B2026.03 | — | — | — | — | — | — | 0.001 | 1.959 | — | — | |
| KDEModel=Qwen3-4B2026.03 | — | — | — | — | — | — | 0.029 | 1.699 | — | — | |
| KDEModel=Qwen3-8B2026.03 | — | — | — | — | — | — | 0.02 | 4.732 | — | — | |
| KDEModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | — | — | 0.022 | 2.617 | — | — | |
| MEEPModel=Phi-4-mini-instruct2026.03 | — | — | — | — | — | — | — | — | -0.009 | 1.227 | |
| MEEPModel=Qwen3-0.6B2026.03 | — | — | — | — | — | — | — | — | -0.008 | 1.231 | |
| MEEPModel=Qwen3-1.7B2026.03 | — | — | — | — | — | — | — | — | -0.006 | 1.223 | |
| MEEPModel=Qwen3-4B2026.03 | — | — | — | — | — | — | — | — | -0.025 | 1.242 | |
| MEEPModel=Qwen3-8B2026.03 | — | — | — | — | — | — | — | — | -0.027 | 1.246 | |
| MEEPModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | — | — | — | — | 0.013 | 1.209 | |
| MINEModel=Phi-4-mini-instruct2026.03 | — | — | 0.098 | 27.308 | — | — | — | — | — | — | |
| MINEModel=Qwen3-0.6B2026.03 | — | — | 0.061 | 11.448 | — | — | — | — | — | — | |
| MINEModel=Qwen3-1.7B2026.03 | — | — | 0.128 | 21.328 | — | — | — | — | — | — | |
| MINEModel=Qwen3-4B2026.03 | — | — | 0.051 | 19.034 | — | — | — | — | — | — | |
| MINEModel=Qwen3-8B2026.03 | — | — | 0.089 | 5.926 | — | — | — | — | — | — | |
| MINEModel=Llama-3.2-3B-Instruct2026.03 | — | — | 0.119 | 3.357 | — | — | — | — | — | — |