Image Editing on GEditBench v2 (test)
1,260Instruction Following ELOGPT Image 1.5 (26-03-04)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPT Image 1.5 (26-03-04)Samples=1,081, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,260 | -13 | 1,149 | -12 | 846 | -13 | 1,071 | -7 | |
| Nano Banana Pro (26-03-04)Samples=1,156, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,126 | -13 | 1,066 | -9 | 1,108 | -11 | 1,096 | -6 | |
| Seedream 4.5 (26-03-11)Samples=1,190, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,111 | -12 | 1,142 | -11 | 1,030 | -11 | 1,089 | -7 | |
| Qwen-Image-Edit-2511Samples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,095 | -10 | 1,060 | -11 | 972 | -9 | 1,038 | -6 | |
| FLUX.2 [klein] 9BSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,083 | -13 | 1,025 | -11 | 1,019 | -10 | 1,039 | -6 | |
| FLUX.2 [dev] TurboSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,068 | -12 | 936 | -10 | 1,064 | -11 | 1,021 | -6 | |
| FLUX.2 [dev]Samples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,037 | -12 | 965 | -10 | 1,018 | -11 | 1,006 | -7 | |
| Qwen-Image-Edit-2509Samples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,033 | -10 | 1,062 | -10 | 955 | -9 | 1,014 | -5 | |
| LongCat-Image-EditSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,018 | -10 | 968 | -10 | 1,017 | -10 | 1,001 | -6 | |
| FLUX.2 [klein] 4BSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 1,007 | -12 | 1,019 | -10 | 1,070 | -10 | 1,031 | -6 | |
| Qwen-Image-EditSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 991 | -10 | 1,073 | -11 | 971 | -11 | 1,010 | -6 | |
| Step1X-Edit-v1p2Samples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 909 | -12 | 1,007 | -12 | 1,067 | -11 | 996 | -6 | |
| FLUX.1 Kontext [dev]Samples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 849 | -13 | 900 | -13 | 840 | -14 | 869 | -7 | |
| BagelSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 820 | -13 | 694 | -17 | 987 | -13 | 851 | -8 | |
| OmniGen V2Samples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 807 | -13 | 910 | -12 | 929 | -13 | 888 | -7 | |
| GLM-ImageSamples=1,200, Evaluation Protocol=GPT-4o / PVC-Judge / Bradley-Terry model2026.03 | 787 | -13 | 1,023 | -11 | 1,109 | -13 | 979 | -6 |