List your company

Text Quality Meta-evaluation on SummEval (Local)

0.687CoherenceDeepSeek-V3
0.355240.441370.52750.61363Feb 17, 2025

Evaluation results

MethodLinks
DeepSeek-V32025.020.6870.6630.6690.630.662
GPT-4 Turbo2025.020.6830.7230.6430.6430.673
Qwen-2.5-72B2025.020.6830.7030.610.630.657
Gemma-2-27B2025.020.6780.6680.650.6220.655
CompassJudger-32B2025.020.6650.6540.5930.6260.634
GPT-4o2025.020.6610.7070.6610.6460.669
GPT-4o mini2025.020.6540.640.6540.6170.641
CRITIQUELLM-6B2025.020.6480.6420.5650.5790.609
Llama-3.1-70B2025.020.6420.5470.6250.5950.602
Phi-4-14B2025.020.6360.6950.6590.6170.652
Prometheus-2-8x7B2025.020.6230.6210.5050.5510.575
GPT-3.5 Turbo2025.020.6090.6150.5690.6010.598
Prometheus-2-7B2025.020.5970.5310.5170.5390.546
Auto-J-13B2025.020.5650.5740.4960.5410.544
Prometheus-13B2025.020.4760.490.5220.490.495
Themis-8B2025.020.3680.3850.3070.3610.355