Mutual Information Estimation on Synthetic Block
0.811PMIScore ρPMIScore
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PMIScoreModel=Qwen3-8B2026.03 | 0.811 | 0.337 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Phi-4-mini-instruct2026.03 | 0.802 | 0.35 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-4B2026.03 | 0.777 | 0.371 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Llama-3.2-3B-Instruct2026.03 | 0.771 | 0.404 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-1.7B2026.03 | 0.649 | 0.692 | — | — | — | — | — | — | — | — | |
| PMIScoreModel=Qwen3-0.6B2026.03 | 0.47 | 1.287 | — | — | — | — | — | — | — | — | |
| InfoNCEModel=Phi-4-mini-instruct2026.03 | — | — | — | — | 0.662 | 1.686 | — | — | — | — | |
| InfoNCEModel=Qwen3-0.6B2026.03 | — | — | — | — | 0.37 | 12.089 | — | — | — | — | |
| InfoNCEModel=Qwen3-1.7B2026.03 | — | — | — | — | 0.464 | 5.63 | — | — | — | — | |
| InfoNCEModel=Qwen3-4B2026.03 | — | — | — | — | 0.639 | 0.85 | — | — | — | — | |
| InfoNCEModel=Qwen3-8B2026.03 | — | — | — | — | 0.75 | 0.702 | — | — | — | — | |
| InfoNCEModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | 0.639 | 3.618 | — | — | — | — | |
| KDEModel=Phi-4-mini-instruct2026.03 | — | — | — | — | — | — | 0.702 | 1.923 | — | — | |
| KDEModel=Qwen3-0.6B2026.03 | — | — | — | — | — | — | 0.39 | 4.268 | — | — | |
| KDEModel=Qwen3-1.7B2026.03 | — | — | — | — | — | — | 0.55 | 2.677 | — | — | |
| KDEModel=Qwen3-4B2026.03 | — | — | — | — | — | — | 0.638 | 2.059 | — | — | |
| KDEModel=Qwen3-8B2026.03 | — | — | — | — | — | — | 0.632 | 2.533 | — | — | |
| KDEModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | — | — | 0.664 | 1.986 | — | — | |
| MEEPModel=Phi-4-mini-instruct2026.03 | — | — | — | — | — | — | — | — | 0.124 | 2.902 | |
| MEEPModel=Qwen3-0.6B2026.03 | — | — | — | — | — | — | — | — | -0.002 | 3.119 | |
| MEEPModel=Qwen3-1.7B2026.03 | — | — | — | — | — | — | — | — | 0.037 | 3.058 | |
| MEEPModel=Qwen3-4B2026.03 | — | — | — | — | — | — | — | — | 0.096 | 2.964 | |
| MEEPModel=Qwen3-8B2026.03 | — | — | — | — | — | — | — | — | 0.191 | 2.789 | |
| MEEPModel=Llama-3.2-3B-Instruct2026.03 | — | — | — | — | — | — | — | — | 0.128 | 2.893 | |
| MINEModel=Phi-4-mini-instruct2026.03 | — | — | 0.754 | 2.52 | — | — | — | — | — | — | |
| MINEModel=Qwen3-0.6B2026.03 | — | — | 0.533 | 14.253 | — | — | — | — | — | — | |
| MINEModel=Qwen3-1.7B2026.03 | — | — | 0.578 | 12.457 | — | — | — | — | — | — | |
| MINEModel=Qwen3-4B2026.03 | — | — | 0.742 | 2.08 | — | — | — | — | — | — | |
| MINEModel=Qwen3-8B2026.03 | — | — | 0.808 | 0.398 | — | — | — | — | — | — | |
| MINEModel=Llama-3.2-3B-Instruct2026.03 | — | — | 0.752 | 1.055 | — | — | — | — | — | — |