List your company
ResearchFormerly WizWand

Correlation with human evaluation on SEEDA E Base

0.974Pearson Correlation (r)GPT-4 S (fluency)
0.67760.754550.83150.90845Feb 13, 2025Apr 13, 2025Jun 12, 2025Aug 10, 2025Oct 9, 2025Dec 7, 2025Feb 5, 2026
Updated 8mo ago

Evaluation results

MethodLinks
GPT-4 S (fluency)2025.020.9740.979
PT-ERRANTReference Set=10 Refs2026.020.9570.986
ERRANTReference Set=10 Refs2026.020.9520.951
UOT-ERRANTReference Set=Official2026.020.950.979
GLEUReference Set=10 Refs2026.020.9490.958
UOT-ERRANTReference Set=10 Refs2026.020.9420.993
GREENaggregation_procedure=w/o TrueSkill2025.020.9320.965
CLEMEReference Set=10 Refs2026.020.9320.937
PTERRANTaggregation_procedure=w/ TrueSkill2025.020.9240.951
PT-ERRANTReference Set=Official2026.020.9240.951
UOT-ERRANTReference Set=NE-Minimal2026.020.9150.93
GLEU+aggregation_procedure=w/o TrueSkill2025.020.9120.944
GREENaggregation_procedure=w/ TrueSkill2025.020.9120.965
GREENReference Set=Official2026.020.9120.965
GPT-4 S (meaning)2025.020.9110.96
GREENReference Set=10 Refs2026.020.910.979
CLEMEReference Set=Official2026.020.910.93
CLEMEReference Set=E-Minimal2026.020.910.965
GLEU+aggregation_procedure=w/ TrueSkill2025.020.9090.965
GLEUReference Set=Official2026.020.9090.965
GPT-4 E (fluency)2025.020.9050.986
GPT-4-EMode=Reference-free2026.020.9050.986
IMPARAaggregation_procedure=w/o TrueSkill2025.020.9020.965
SOMEaggregation_procedure=w/o TrueSkill2025.020.9010.951
IMPARAaggregation_procedure=w/ TrueSkill2025.020.9010.944
UOT-ERRANTReference Set=E-Minimal2026.020.9010.909
IMPARAMode=Reference-free2026.020.9010.944
PT-ERRANTReference Set=E-Minimal2026.020.8940.888
SOMEaggregation_procedure=w/ TrueSkill2025.020.8930.944
SOMEMode=Reference-free2026.020.8930.944
Qwen3-8B-SMode=Reference-free2026.020.8860.965
ERRANTaggregation_procedure=w/ TrueSkill2025.020.8810.895
ERRANTReference Set=Official2026.020.8810.895
ERRANTReference Set=E-Minimal2026.020.8640.804
GREENReference Set=E-Minimal2026.020.8580.93
GLEUReference Set=E-Minimal2026.020.8480.916
Scribendiaggregation_procedure=w/ TrueSkill2025.020.8370.888
ScribendiMode=Reference-free2026.020.8370.888
Scribendiaggregation_procedure=w/o TrueSkill2025.020.8250.839
GLEUReference Set=NE-Minimal2026.020.8080.895
PT-ERRANTReference Set=NE-Minimal2026.020.8020.832
PTERRANTaggregation_procedure=w/o TrueSkill2025.020.7880.874
ERRANTReference Set=NE-Minimal2026.020.740.72
CLEMEReference Set=NE-Minimal2026.020.7160.706
GREENReference Set=NE-Minimal2026.020.70.825
ERRANTaggregation_procedure=w/o TrueSkill2025.020.6890.643