Text-to-Image Alignment Scoring on LongT2IBench (test)
0.781SRCC (30-50 words)LongT2IExpert
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LongT2IExpertFine-tuned=Implicitly mentioned as proposed model with LoRA2025.12 | 0.781 | 0.789 | 0.605 | 0.626 | 0.548 | 0.558 | 0.435 | 0.443 | 0.431 | 0.375 | 0.558 | 0.557 | 0.557 | |
| FGA-BLIP2Fine-tuned=true2025.12 | 0.57 | 0.568 | 0.514 | 0.527 | 0.371 | 0.475 | 0.327 | 0.355 | 0.126 | 0.144 | 0.406 | 0.444 | 0.425 | |
| HPSv2Fine-tuned=false2025.12 | 0.54 | 0.534 | 0.479 | 0.473 | 0.394 | 0.417 | 0.395 | 0.408 | 0.148 | 0.151 | 0.381 | 0.392 | 0.387 | |
| ImageRewardFine-tuned=true2025.12 | 0.538 | 0.584 | 0.546 | 0.574 | 0.384 | 0.398 | 0.399 | 0.396 | 0.167 | 0.195 | 0.438 | 0.439 | 0.439 | |
| VQAScoreFine-tuned=false2025.12 | 0.504 | 0.385 | 0.333 | 0.36 | 0.27 | 0.389 | 0.195 | 0.2 | 0.242 | 0.225 | 0.298 | 0.291 | 0.295 | |
| Q-Eval-ScoreFine-tuned=false2025.12 | 0.47 | 0.416 | 0.46 | 0.459 | 0.339 | 0.382 | 0.32 | 0.301 | 0.422 | 0.365 | 0.361 | 0.355 | 0.358 | |
| PickScoreFine-tuned=false2025.12 | 0.437 | 0.55 | 0.368 | 0.359 | 0.313 | 0.328 | 0.352 | 0.373 | 0.153 | 0.165 | 0.327 | 0.344 | 0.336 | |
| FGA-BLIP2Fine-tuned=false2025.12 | 0.414 | 0.399 | 0.308 | 0.33 | 0.193 | 0.299 | 0.16 | 0.171 | 0.13 | 0.155 | 0.23 | 0.262 | 0.246 | |
| PickScoreFine-tuned=true2025.12 | 0.387 | 0.51 | 0.53 | 0.521 | 0.393 | 0.432 | 0.419 | 0.372 | 0.25 | 0.264 | 0.438 | 0.439 | 0.438 | |
| BLIP2ScoreFine-tuned=false2025.12 | 0.384 | 0.231 | 0.342 | 0.358 | 0.19 | 0.155 | 0.215 | 0.191 | 0.149 | 0.061 | 0.266 | 0.223 | 0.245 | |
| ImageRewardFine-tuned=false2025.12 | 0.283 | 0.339 | 0.27 | 0.319 | 0.181 | 0.226 | 0.187 | 0.188 | -0.023 | 0.072 | 0.21 | 0.244 | 0.227 | |
| CLIPScoreFine-tuned=false2025.12 | 0.224 | 0.235 | 0.349 | 0.37 | 0.271 | 0.24 | 0.208 | 0.202 | 0.209 | 0.184 | 0.269 | 0.264 | 0.267 |