List your company

Privacy Agreement on 250-text benchmark (test)

0.737Krippendorff's AlphaEttin-150M
0.376120.469810.56350.65719Mar 31, 2026

Evaluation results

MethodLinks
Ettin-150MComparison=vs. Human avg2026.030.737
Mistral Large 3 (675b)Comparison=vs. Human avg2026.030.716
Ettin-17MComparison=vs. Human avg2026.030.708
Mistral-7bComparison=vs. Human avg2026.030.563
Inter-HumanComparison=pairwise avg2026.030.54
Ettin-150MComparison=pairwise w/ humans2026.030.514
Mistral Large 3 (675b)Comparison=pairwise w/ humans2026.030.502
Ettin-17MComparison=pairwise w/ humans2026.030.498
Mistral-7bComparison=pairwise w/ humans2026.030.409
Inter-HumanComparison=overall2026.030.39