List your company
ResearchFormerly WizWand

Human Consistency Evaluation on GenAI-Bench

38.4Kendall's Tau-cVQAScore
0.0249.98719.9529.913May 20, 2026
Updated 5mo ago

Evaluation results

MethodLinks
VQAScoreMethod Category=LLM-based, Backbone=CLIP-FlanT5-XXL2026.0538.4—37.949.9
EXPERTMethod Category=LLM-based2026.0535.6—35.146.3
BEiTScoreMethod Category=Encoder-based, Backbone=ViT-L/142026.0535.6—35.146.5
FLEURMethod Category=LLM-based2026.0534—33.544.5
BEiTScoreMethod Category=Encoder-based, Backbone=ViT-L/14, Training Stage=w/o Stage 12026.0533.1—32.743.2
BEiTScoreMethod Category=Encoder-based, Backbone=ViT-B/322026.0533.1—32.743.2
BEiTScoreMethod Category=Encoder-based, Backbone=ViT-B/32, Training Stage=w/o Stage 12026.0528—27.636.7
PAC-S++Method Category=Encoder-based, Backbone=ViT-L2026.0516.3—16.121.6
LongCLIP-SMethod Category=Encoder-based, Backbone=ViT-L2026.0515—14.819.8
PAC-S++Method Category=Encoder-based, Backbone=ViT-B2026.0514.6—14.419.3
LongCLIP-SMethod Category=Encoder-based, Backbone=ViT-B2026.0513.4—13.217.7
PAC-SMethod Category=Encoder-based, Backbone=ViT-B2026.0512.9—12.717.1
PAC-SMethod Category=Encoder-based, Backbone=ViT-L2026.0512.2—12.116.3
CLIP-SMethod Category=Encoder-based, Backbone=ViT-L2026.0511.8—11.615.6
CLIP-SMethod Category=Encoder-based, Backbone=ViT-B2026.0510—9.913.3
SPECSMethod Category=Encoder-based2026.051.5—1.41.9
Gemini-2.5-ProModel Category=Closed-source2025.06—61.6——
GPT-4oModel Category=Closed-source2025.06—53.6——
LLaVA-CriticModel Category=Open-source, Parameters=7B2025.06—29.8——
LLaVA-CriticModel Category=Open-source, Parameters=72B2025.06—46.8——
LLaVA-OVModel Category=Open-source, Parameters=7B2025.06—13.6——
LLaVA-OVModel Category=Open-source, Parameters=72B2025.06—46.3——
MinosModel Category=Open-source, Parameters=8B2025.06—55.9——
Prometheus-VModel Category=Open-source, Parameters=7B2025.06—16——
Qwen3-VLModel Category=Open-source, Parameters=8B2025.06—53.6——
UnifiedReward_LModel Category=Open-source, Parameters=7B2025.06—54.4——
UnifiedReward_QModel Category=Open-source, Parameters=8B2025.06—54.7——