Perceptual Quality Assessment on TIEdit 1.0 (test)
0.7715SRCCEditProbe
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| EditProbeMode=Cross-modal stage-wise probing2026.03 | 0.7715 | 0.7892 | 0.5887 | |
| EditProbeMode=Cross-modal stage-wise probing2026.03 | 0.6959 | 0.7064 | 0.5095 | |
| VGG16Category=Deep Learning-based IQA Models2026.03 | 0.5955 | 0.5228 | 0.4181 | |
| VGG16Category=Deep Learning-based IQA Models2026.03 | 0.5323 | 0.5057 | 0.3683 | |
| VGG19Category=Deep Learning-based IQA Models2026.03 | 0.5268 | 0.4805 | 0.3623 | |
| MANIQACategory=Deep Learning-based IQA Models2026.03 | 0.4755 | 0.5022 | 0.3326 | |
| DBCNNCategory=Deep Learning-based IQA Models2026.03 | 0.4546 | 0.5173 | 0.3166 | |
| TOPIQCategory=Deep Learning-based IQA Models2026.03 | 0.4473 | 0.4844 | 0.3117 | |
| MS-SSIMCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.4274 | 0.4018 | 0.2863 | |
| CLIPIQACategory=Deep Learning-based IQA Models2026.03 | 0.4199 | 0.4375 | 0.2604 | |
| PAMSECategory=Traditional Full-Reference (FR) IQA2026.03 | 0.4198 | 0.4106 | 0.2822 | |
| NQMCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.4105 | 0.4064 | 0.2752 | |
| VSICategory=Traditional Full-Reference (FR) IQA2026.03 | 0.407 | 0.3793 | 0.2732 | |
| IW-MSECategory=Traditional Full-Reference (FR) IQA2026.03 | 0.3976 | 0.2298 | 0.2666 | |
| IW-PSNRCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.3976 | 0.3751 | 0.2666 | |
| FSIMCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.3906 | 0.3514 | 0.262 | |
| FSIMcCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.3896 | 0.3495 | 0.2617 | |
| MSECategory=Traditional Full-Reference (FR) IQA2026.03 | 0.3808 | 0.3698 | 0.2541 | |
| PSNRCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.3808 | 0.3689 | 0.2541 | |
| HyperIQACategory=Deep Learning-based IQA Models2026.03 | 0.3664 | 0.3928 | 0.2497 | |
| SSIM-2Category=Traditional Full-Reference (FR) IQA2026.03 | 0.3407 | 0.3089 | 0.2268 | |
| WaDIQaMCategory=Deep Learning-based IQA Models2026.03 | 0.2763 | 0.2871 | 0.1876 | |
| CNNIQACategory=Deep Learning-based IQA Models2026.03 | 0.2729 | 0.3012 | 0.1845 | |
| PAMSECategory=Traditional Full-Reference (FR) IQA2026.03 | 0.247 | 0.3158 | 0.3846 | |
| NIMACategory=Deep Learning-based IQA Models2026.03 | 0.2412 | 0.2487 | 0.1617 | |
| SSIM-1Category=Traditional Full-Reference (FR) IQA2026.03 | 0.2228 | 0.1939 | 0.1473 | |
| VIFCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.1768 | 0.0761 | 0.1245 | |
| IFCCategory=Traditional Full-Reference (FR) IQA2026.03 | 0.1624 | 0.3137 | 0.1163 | |
| AestheticScoreCategory=Vision-Language and Preference-based2026.03 | 0.1576 | 0.1864 | 0.1057 | |
| BRISQUECategory=Traditional No-Reference (NR) IQA2026.03 | 0.1329 | 0.1018 | 0.0893 | |
| HIGRADE-1Category=Traditional No-Reference (NR) IQA2026.03 | 0.1253 | 0.1212 | 0.0826 | |
| HIGRADE-2Category=Traditional No-Reference (NR) IQA2026.03 | 0.0751 | 0.0776 | 0.0495 | |
| NIQECategory=Traditional No-Reference (NR) IQA2026.03 | 0.0693 | 0.0899 | 0.0478 | |
| QACCategory=Traditional No-Reference (NR) IQA2026.03 | 0.0559 | 0.0646 | 0.0358 | |
| ImageRewardCategory=Vision-Language and Preference-based2026.03 | 0.0453 | 0.0711 | 0.03 | |
| BMPRICategory=Traditional No-Reference (NR) IQA2026.03 | 0.0307 | 0.0139 | 0.0207 | |
| BLIPScoreCategory=Vision-Language and Preference-based2026.03 | 0.02 | 0.0767 | 0.0099 | |
| GPT-4Category=LLM-based Evaluator2026.03 | 0.0084 | 0.0065 | 0.0653 | |
| CLIPScoreCategory=Vision-Language and Preference-based2026.03 | 0.0053 | 0.0222 | 0.004 | |
| BPRICategory=Traditional No-Reference (NR) IQA2026.03 | 0.0005 | 0.0141 | 0.0015 |