Mutual Information Estimation on Synthetic Diagonal
0.664PMI ρ ScorePMIScore
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PMIScoreModel=Phi-4-mini-instruct2026.03 | 0.664 | 1.728 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-8B2026.03 | 0.659 | 1.769 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Llama-3.2-3B-Instruct2026.03 | 0.647 | 2.093 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-4B2026.03 | 0.629 | 1.942 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-1.7B2026.03 | 0.608 | 2.545 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-0.6B2026.03 | 0.525 | 3.21 | — | — | — | — | — | — | — | — | |
| InfoNCEModel=Phi-4-mini-instruct2026.03 | — | — | — | — | 0.561 | 2.786 | — | — | — | — | |
| InfoNCEModel=Qwen3-0.6B2026.03 | — | — | — | — | 0.387 | 8.5 | — | — | — | — | |
| InfoNCEModel=Qwen3-1.7B2026.03 | — | — | — | — | 0.545 | 9.884 | — | — | — | — | |
| InfoNCEModel=Qwen3-4B2026.03 | — | — | — | — | 0.549 | 4.612 | — | — | — | — | |
| InfoNCEModel=Qwen3-8B2026.03 | — | — | — | — | 0.598 | 2.397 | — | — | — | — | |
| InfoNCEModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | 0.598 | 2.4 | — | — | — | — | |
| KDEModel=Phi-4-mini-instruct2026.03 | — | — | — | — | — | — | 0.609 | 5.167 | — | — | |
| KDEModel=Qwen3-0.6B2026.03 | — | — | — | — | — | — | 0.381 | 8.336 | — | — | |
| KDEModel=Qwen3-1.7B2026.03 | — | — | — | — | — | — | 0.392 | 6.756 | — | — | |
| KDEModel=Qwen3-4B2026.03 | — | — | — | — | — | — | 0.543 | 5.642 | — | — | |
| KDEModel=Qwen3-8B2026.03 | — | — | — | — | — | — | 0.594 | 5.115 | — | — | |
| KDEModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | — | — | 0.59 | 5.028 | — | — | |
| MEEPModel=Phi-4-mini-instruct2026.03 | — | — | — | — | — | — | — | — | 0.12 | 5.781 | |
| MEEPModel=Qwen3-0.6B2026.03 | — | — | — | — | — | — | — | — | 0.021 | 6.021 | |
| MEEPModel=Qwen3-1.7B2026.03 | — | — | — | — | — | — | — | — | 0.048 | 5.926 | |
| MEEPModel=Qwen3-4B2026.03 | — | — | — | — | — | — | — | — | 0.05 | 5.948 | |
| MEEPModel=Qwen3-8B2026.03 | — | — | — | — | — | — | — | — | 0.321 | 5.231 | |
| MEEPModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | — | — | — | — | 0.2 | 5.578 | |
| MINEModel=Phi-4-mini-instruct2026.03 | — | — | 0.618 | 44.496 | — | — | — | — | — | — | |
| MINEModel=Qwen3-0.6B2026.03 | — | — | 0.518 | 58.645 | — | — | — | — | — | — | |
| MINEModel=Qwen3-1.7B2026.03 | — | — | 0.589 | 52.908 | — | — | — | — | — | — | |
| MINEModel=Qwen3-4B2026.03 | — | — | 0.611 | 26.183 | — | — | — | — | — | — | |
| MINEModel=Qwen3-8B2026.03 | — | — | 0.637 | 7.802 | — | — | — | — | — | — | |
| MINEModel=Llama-3.2-3B-Instruct2026.03 | — | — | 0.634 | 12.449 | — | — | — | — | — | — |