PIE-Bench
Benchmarks
TaskDatasetSOTA resultTrendResults
PIE-Bench
36.02PSNR
257
PIE-Bench (test)
33.45PSNR
55
PIE-Bench
29.78CLIP Similarity (Whole)
40
PIE-Bench 1.0 (test)
30.21PSNR
22
PIE-Bench Large Edits (random images (140 images))
25.11CLIP Score
20
PIE-Bench (test)
37.65PSNR
18
PIE-Bench
1.27MSE
15
PIE-Bench Neg
0.275Positive Prompt CLIP Score
14
PIE-Bench (test)
78Preference Rate (Ours)
12
PIE-Bench++ (test)
24.14PSNR
12
PIE-Bench (556 samples)
61.4FID
11
PIE-Bench
0.61Delta Smoothness
11
PIE-Bench Small Edits
33.25PSNR
10
PIE-Bench
36.8LPIPS
10
PIE-Bench
1.25Rank
10
PIE-Bench 700 images
0.14LPIPS
10
PIE-Bench 700 images
0.023Structure Distance
9
PIE-Bench v1.5 (test)
20.67Structure Distance
8
PIE-Bench FLUX.1 (dev)
6.62Rank
8
PIE-Bench (test)
14,520Structure Distance
8
PIE-Bench++
26.88CLIP-T
7
PIE-Bench SD3.5-Medium
2.5Rank
6
PIE-Bench ChangePose
6.99GPT-4o Score
6
PIE-Bench++ 12
0.741CLIP Similarity
6
PIE-Bench
18.22Inference Time (s)
6