Mutual Information Estimation on Gaussian d=20 (test)
0.01BiasGAN-DIME
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GAN-DIMEMI level=10, Batch size (N)=512, Architecture=Joint2023.05 | 0.01 | 0.17 | 0.18 | |
| GAN-DIMEMI level=8, Batch size (N)=1024, Architecture=Joint2023.05 | 0.04 | 0.07 | 0.08 | |
| CPCMI level=2, Batch size (N)=1024, Architecture=Joint2023.05 | 0.05 | 0 | 0.01 | |
| KL-DIMEMI level=2, Batch size (N)=1024, Architecture=Joint2023.05 | 0.06 | 0.01 | 0.01 | |
| HD-DIMEMI level=2, Batch size (N)=1024, Architecture=Joint2023.05 | 0.07 | 0.01 | 0.01 | |
| KL-DIMEMI level=2, Batch size (N)=512, Architecture=Joint2023.05 | 0.07 | 0.01 | 0.01 | |
| HD-DIMEMI level=2, Batch size (N)=512, Architecture=Joint2023.05 | 0.08 | 0.01 | 0.02 | |
| CPCMI level=2, Batch size (N)=512, Architecture=Joint2023.05 | 0.08 | 0.01 | 0.01 | |
| GAN-DIMEMI level=2, Batch size (N)=1024, Architecture=Joint2023.05 | 0.09 | 0.01 | 0.02 | |
| KL-DIMEMI level=4, Batch size (N)=1024, Architecture=Joint2023.05 | 0.1 | 0.01 | 0.02 | |
| GAN-DIMEMI level=2, Batch size (N)=512, Architecture=Joint2023.05 | 0.11 | 0.01 | 0.03 | |
| HD-DIMEMI level=4, Batch size (N)=1024, Architecture=Joint2023.05 | 0.12 | 0.02 | 0.04 | |
| KL-DIMEMI level=4, Batch size (N)=512, Architecture=Joint2023.05 | 0.12 | 0.01 | 0.03 | |
| GAN-DIMEMI level=6, Batch size (N)=1024, Architecture=Joint2023.05 | 0.12 | 0.04 | 0.05 | |
| GAN-DIMEMI level=4, Batch size (N)=1024, Architecture=Joint2023.05 | 0.13 | 0.02 | 0.04 | |
| GAN-DIMEMI level=8, Batch size (N)=512, Architecture=Joint2023.05 | 0.14 | 0.11 | 0.13 | |
| GAN-DIMEMI level=4, Batch size (N)=512, Architecture=Joint2023.05 | 0.15 | 0.03 | 0.05 | |
| HD-DIMEMI level=4, Batch size (N)=512, Architecture=Joint2023.05 | 0.15 | 0.03 | 0.05 | |
| GAN-DIMEMI level=6, Batch size (N)=512, Architecture=Joint2023.05 | 0.16 | 0.06 | 0.09 | |
| GAN-DIMEMI level=10, Batch size (N)=1024, Architecture=Joint2023.05 | 0.16 | 0.12 | 0.15 | |
| KL-DIMEMI level=6, Batch size (N)=1024, Architecture=Joint2023.05 | 0.17 | 0.01 | 0.04 | |
| HD-DIMEMI level=6, Batch size (N)=1024, Architecture=Joint2023.05 | 0.2 | 0.04 | 0.08 | |
| KL-DIMEMI level=6, Batch size (N)=512, Architecture=Joint2023.05 | 0.21 | 0.02 | 0.06 | |
| CPCMI level=4, Batch size (N)=1024, Architecture=Joint2023.05 | 0.23 | 0 | 0.06 | |
| HD-DIMEMI level=6, Batch size (N)=512, Architecture=Joint2023.05 | 0.24 | 0.05 | 0.11 | |
| SMILEMI level=2, Batch size (N)=512, Architecture=Joint2023.05 | 0.25 | 0.01 | 0.08 | |
| SMILEMI level=2, Batch size (N)=1024, Architecture=Joint2023.05 | 0.27 | 0.01 | 0.08 | |
| HD-DIMEMI level=8, Batch size (N)=1024, Architecture=Joint2023.05 | 0.3 | 0.06 | 0.15 | |
| KL-DIMEMI level=8, Batch size (N)=1024, Architecture=Joint2023.05 | 0.31 | 0.01 | 0.11 | |
| NJEEMI level=10, Batch size (N)=512, Architecture=Joint2023.05 | 0.32 | 0.02 | 0.12 | |
| CPCMI level=4, Batch size (N)=512, Architecture=Joint2023.05 | 0.34 | 0.01 | 0.13 | |
| NJEEMI level=8, Batch size (N)=512, Architecture=Joint2023.05 | 0.34 | 0.02 | 0.14 | |
| NJEEMI level=6, Batch size (N)=512, Architecture=Joint2023.05 | 0.37 | 0.02 | 0.16 | |
| HD-DIMEMI level=8, Batch size (N)=512, Architecture=Joint2023.05 | 0.37 | 0.07 | 0.21 | |
| KL-DIMEMI level=8, Batch size (N)=512, Architecture=Joint2023.05 | 0.38 | 0.02 | 0.17 | |
| NJEEMI level=10, Batch size (N)=1024, Architecture=Joint2023.05 | 0.38 | 0.01 | 0.16 | |
| NJEEMI level=4, Batch size (N)=512, Architecture=Joint2023.05 | 0.4 | 0.01 | 0.18 | |
| NJEEMI level=8, Batch size (N)=1024, Architecture=Joint2023.05 | 0.4 | 0.01 | 0.17 | |
| NJEEMI level=6, Batch size (N)=1024, Architecture=Joint2023.05 | 0.41 | 0.01 | 0.18 | |
| NJEEMI level=2, Batch size (N)=512, Architecture=Joint2023.05 | 0.42 | 0.01 | 0.18 | |
| NJEEMI level=4, Batch size (N)=1024, Architecture=Joint2023.05 | 0.42 | 0.01 | 0.18 | |
| HD-DIMEMI level=10, Batch size (N)=1024, Architecture=Joint2023.05 | 0.43 | 0.08 | 0.26 | |
| NJEEMI level=2, Batch size (N)=1024, Architecture=Joint2023.05 | 0.44 | 0 | 0.2 | |
| HD-DIMEMI level=10, Batch size (N)=512, Architecture=Joint2023.05 | 0.47 | 0.09 | 0.31 | |
| SMILEMI level=4, Batch size (N)=512, Architecture=Joint2023.05 | 0.48 | 0.03 | 0.26 | |
| SMILEMI level=4, Batch size (N)=1024, Architecture=Joint2023.05 | 0.51 | 0.02 | 0.28 | |
| KL-DIMEMI level=10, Batch size (N)=1024, Architecture=Joint2023.05 | 0.56 | 0.01 | 0.33 | |
| SMILEMI level=6, Batch size (N)=512, Architecture=Joint2023.05 | 0.64 | 0.06 | 0.47 | |
| SMILEMI level=6, Batch size (N)=1024, Architecture=Joint2023.05 | 0.67 | 0.03 | 0.48 | |
| KL-DIMEMI level=10, Batch size (N)=512, Architecture=Joint2023.05 | 0.69 | 0.02 | 0.49 | |
| SMILEMI level=8, Batch size (N)=1024, Architecture=Joint2023.05 | 0.73 | 0.07 | 0.61 | |
| SMILEMI level=8, Batch size (N)=512, Architecture=Joint2023.05 | 0.74 | 0.11 | 0.66 | |
| CPCMI level=6, Batch size (N)=1024, Architecture=Joint2023.05 | 0.8 | 0 | 0.64 | |
| SMILEMI level=10, Batch size (N)=1024, Architecture=Joint2023.05 | 0.83 | 0.11 | 0.8 | |
| SMILEMI level=10, Batch size (N)=512, Architecture=Joint2023.05 | 0.86 | 0.17 | 0.9 | |
| CPCMI level=6, Batch size (N)=512, Architecture=Joint2023.05 | 1.07 | 0.01 | 1.16 | |
| CPCMI level=8, Batch size (N)=1024, Architecture=Joint2023.05 | 1.87 | 0 | 3.48 | |
| CPCMI level=8, Batch size (N)=512, Architecture=Joint2023.05 | 2.32 | 0 | 5.38 | |
| CPCMI level=10, Batch size (N)=1024, Architecture=Joint2023.05 | 3.37 | 0 | 11.38 | |
| CPCMI level=10, Batch size (N)=512, Architecture=Joint2023.05 | 3.96 | 0 | 15.67 |