Perceptual Similarity on BAPPS (val)
73.92AFC (Overall)Human
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HumanSubtype=Oracle2018.01 | 73.9 | 80.8 | 84.4 | 82.6 | 73.4 | 67.1 | 68.8 | 68.6 | 69.5 | — | — | — | |
| LPIPS (Alex) (Retrained)Backbone=AlexNet, retrained_from_scratch=true, trained_on_patches_of_size_256=true, setup=our setup (‡)2022.07 | 70.65 | — | — | — | — | — | — | — | — | 2.87 | 3.92 | 3.74 | |
| LPIPS (Alex) (Trained on 256 patches)Backbone=AlexNet, trained_on_patches_of_size_256=true, setup=author setup (†)2022.07 | 70.54 | — | — | — | — | — | — | — | — | 2.58 | 3.59 | 3.53 | |
| Shift-tolerant LPIPS (Alex) (Retrained)Backbone=AlexNet, retrained_from_scratch=true, trained_on_patches_of_size_256=true, setup=our setup (‡)2022.07 | 70.48 | — | — | — | — | — | — | — | — | 0.57 | 1.06 | 1.5 | |
| Shift-tolerant LPIPS (Alex)Backbone=AlexNet, trained_on_patches_of_size_256=true, setup=author setup (†)2022.07 | 70.39 | — | — | — | — | — | — | — | — | 0.66 | 1.24 | 1.79 | |
| LPIPSBackbone=AlexNet, Evaluation Protocol=scratch2018.01 | 70.2 | 77.6 | 82.8 | 80.2 | 71.1 | 61 | 65.6 | 63.3 | 65.2 | — | — | — | |
| LPIPSBackbone=SqueezeNet, Evaluation Protocol=linear2018.01 | 70 | 76.1 | 83.5 | 79.8 | 71.1 | 60.8 | 65.3 | 63.2 | 65.1 | — | — | — | |
| LPIPSBackbone=VGG, Evaluation Protocol=scratch2018.01 | 70 | 77.9 | 83.7 | 80.8 | 71.1 | 60.6 | 64 | 62.9 | 64.6 | — | — | — | |
| LPIPSBackbone=AlexNet, Evaluation Protocol=linear2018.01 | 69.8 | 73.9 | 83.4 | 78.7 | 71.5 | 61.2 | 65.3 | 63.2 | 65.3 | — | — | — | |
| LPIPSBackbone=VGG, Evaluation Protocol=tune2018.01 | 69.8 | 79.3 | 83.5 | 81.4 | 69.8 | 60.5 | 63.4 | 62.3 | 64 | — | — | — | |
| LPIPSBackbone=AlexNet, Evaluation Protocol=tune2018.01 | 69.7 | 77.7 | 83.5 | 80.6 | 69.1 | 60.5 | 64.8 | 62.9 | 64.3 | — | — | — | |
| LPIPSBackbone=SqueezeNet, Evaluation Protocol=tune2018.01 | 69.6 | 76.7 | 83.2 | 79.9 | 70.4 | 61.1 | 63.2 | 63.2 | 64.5 | — | — | — | |
| LPIPSBackbone=VGG, Evaluation Protocol=linear2018.01 | 69.2 | 76 | 82.8 | 79.4 | 70.5 | 60.5 | 62.5 | 63 | 64.1 | — | — | — | |
| LPIPSBackbone=SqueezeNet, Evaluation Protocol=scratch2018.01 | 69.2 | 74.9 | 83.1 | 79 | 71.1 | 60.8 | 63 | 62.4 | 64.3 | — | — | — | |
| AlexNetSubtype=Net (Supervised)2018.01 | 68.9 | 70.6 | 83.1 | 76.8 | 71.7 | 60.7 | 65 | 62.7 | 65 | — | — | — | |
| DISTS2022.07 | 68.83 | — | — | — | — | — | — | — | — | 2.85 | 2.89 | 4.03 | |
| SqueezeNetSubtype=Net (Supervised)2018.01 | 68.6 | 73.3 | 82.6 | 78 | 70.1 | 60.1 | 63.6 | 62 | 64 | — | — | — | |
| LPIPS (Alex)Backbone=AlexNet2022.07 | 68.59 | — | — | — | — | — | — | — | — | 2.81 | 3.41 | 3.84 | |
| BIGANSubtype=Net (Self-supervised)2018.01 | 68.4 | 69.8 | 83 | 76.4 | 70.7 | 60.5 | 63.7 | 62.5 | 64.4 | — | — | — | |
| E-LPIPS2022.07 | 68.22 | — | — | — | — | — | — | — | — | 5.84 | 5.86 | 5.77 | |
| PuzzleSubtype=Net (Self-supervised)2018.01 | 68.1 | 71.5 | 82 | 76.8 | 70.2 | 60.2 | 62.8 | 61.8 | 63.8 | — | — | — | |
| Split-BrainSubtype=Net (Self-supervised)2018.01 | 67.5 | 69.5 | 81.4 | 75.5 | 69.6 | 59.3 | 64.3 | 61.1 | 63.6 | — | — | — | |
| PIM-12022.07 | 67.45 | — | — | — | — | — | — | — | — | 0.79 | 1.7 | 2.52 | |
| PIM-52022.07 | 67.38 | — | — | — | — | — | — | — | — | 1.01 | 2.96 | — | |
| WatchingSubtype=Net (Self-supervised)2018.01 | 67.2 | 66.5 | 80.7 | 73.6 | 69.6 | 60.6 | 64.4 | 61.6 | 64.1 | — | — | — | |
| VGGSubtype=Net (Supervised)2018.01 | 67 | 70.1 | 81.3 | 75.7 | 69 | 59 | 60.2 | 62.1 | 62.6 | — | — | — | |
| K-meansSubtype=Net (Unsupervised)2018.01 | 66.6 | 66.6 | 83 | 74.8 | 67.3 | 59.8 | 63.1 | 59.8 | 62.5 | — | — | — | |
| GaussianSubtype=Net (Random)2018.01 | 64.3 | 60.5 | 80.7 | 70.6 | 64.9 | 59.5 | 62.8 | 57.2 | 61.1 | — | — | — | |
| PIEAPP Sparse2022.07 | 64.2 | — | — | — | — | — | — | — | — | 2.83 | 3.19 | 3.81 | |
| PIEAPP Dense2022.07 | 64.15 | — | — | — | — | — | — | — | — | 2.97 | 1.37 | 3.33 | |
| GTI-CNN2022.07 | 63.87 | — | — | — | — | — | — | — | — | 3.95 | 4.91 | 7.88 | |
| FSIMCSubtype=Low-level2018.01 | 63.8 | 61.4 | 78.6 | 70 | 68.1 | 59.5 | 57.3 | 57.7 | 60.6 | — | — | — | |
| L2Subtype=Low-level2018.01 | 63.2 | 59.9 | 77.8 | 68.9 | 64.7 | 58.2 | 63.5 | 55 | 60.3 | — | — | — | |
| SSIMSubtype=Low-level2018.01 | 63.1 | 60.3 | 79.1 | 69.7 | 65.1 | 58.6 | 58.1 | 57.7 | 59.8 | — | — | — | |
| L22022.07 | 62.92 | — | — | — | — | — | — | — | — | 3.59 | 7.55 | 10.82 | |
| MS-SSIM2022.07 | 62.54 | — | — | — | — | — | — | — | — | 2.22 | 5.83 | 10.66 | |
| CW-SSIM2022.07 | 61.48 | — | — | — | — | — | — | — | — | 3.91 | 6.88 | 9.47 | |
| SSIM2022.07 | 61.41 | — | — | — | — | — | — | — | — | 3.16 | 7.2 | 13.73 | |
| HDR-VDPSubtype=Low-level2018.01 | 61.4 | 57.4 | 76.8 | 67.1 | 64.7 | 59 | 53.7 | 56.6 | 58.5 | — | — | — |