List your company
ResearchFormerly WizWand

Judge Agreement on MT-bench Second Turn

95AgreementG4-Pair
57.5667.287786.72Jun 9, 2023
Updated 8mo ago

Evaluation results

MethodLinks
G4-PairSetup=S2 (R=50%), Compared against=G4-Single2023.0695727
G4-PSetup=S2 (R=50%), Comparison Judge=G4-S2023.0695727
HumanSetup=S2 (R=50%), Comparison Judge=Human-M2023.0691629
G4-SSetup=S2 (R=50%), Comparison Judge=Author2023.0689193
G4-PSetup=S2 (R=50%), Comparison Judge=Author2023.0688205
AuthorSetup=S2 (R=50%), Comparison Judge=Author2023.068731
AuthorSetup=S2 (R=50%), Comparison Judge=Human2023.0686273
G4-PairSetup=S2 (R=50%), Compared against=Human2023.0685864
G4-PSetup=S2 (R=50%), Comparison Judge=Human2023.0685864
G4-PSetup=S2 (R=50%), Comparison Judge=Human-M2023.0685557
G4-SSetup=S2 (R=50%), Comparison Judge=Human-M2023.0685506
G4-SingleSetup=S2 (R=50%), Compared against=Human2023.0684776
G4-SSetup=S2 (R=50%), Comparison Judge=Human2023.0684776
AuthorSetup=S2 (R=50%), Comparison Judge=Human-M2023.068454
HumanSetup=S1 (R=33%), Comparison Judge=Human-M2023.0683877
HumanSetup=S2 (R=50%), Compared against=G4-Single2023.0682474
HumanSetup=S2 (R=50%), Comparison Judge=Human2023.0682474
G4-PairSetup=S1 (R=33%), Compared against=G4-Single2023.06701,161
G4-PSetup=S1 (R=33%), Comparison Judge=G4-S2023.06701,161
G4-PSetup=S1 (R=33%), Comparison Judge=Human-M2023.0668812
AuthorSetup=S1 (R=33%), Comparison Judge=Human2023.0668413
HumanSetup=S1 (R=33%), Compared against=G4-Single2023.0667707
AuthorSetup=S1 (R=33%), Comparison Judge=Author2023.066749
HumanSetup=S1 (R=33%), Comparison Judge=Human2023.0667707
G4-PairSetup=S1 (R=33%), Compared against=Human2023.06661,325
G4-PSetup=S1 (R=33%), Comparison Judge=Author2023.0666341
G4-PSetup=S1 (R=33%), Comparison Judge=Human2023.06661,325
G4-SSetup=S1 (R=33%), Comparison Judge=Author2023.0665331
AuthorSetup=S1 (R=33%), Comparison Judge=Human-M2023.066387
G4-SSetup=S1 (R=33%), Comparison Judge=Human-M2023.0661783
G4-SingleSetup=S1 (R=33%), Compared against=Human2023.06591,285
G4-SSetup=S1 (R=33%), Comparison Judge=Human2023.06591,285