List your company

Text Summarization Hallucination Evaluation on MultiNews

19AccuracyMEAP
9.6412.0714.516.93Feb 11, 2025

Evaluation results

MethodLinks
MEAPTraining Objective=Mask-Enhanced Autoregressive Prediction, LLM Judge=Deepseek-V32025.0219
NTPTraining Objective=Next Token Prediction, LLM Judge=Deepseek-V32025.0217
MEAPTraining Objective=Mask-Enhanced Autoregressive Prediction, LLM Judge=Qwen-Plus2025.0214
MEAPTraining Objective=Mask-Enhanced Autoregressive Prediction, LLM Judge=GPT-4o2025.0213
NTPTraining Objective=Next Token Prediction, LLM Judge=Qwen-Plus2025.0211
NTPTraining Objective=Next Token Prediction, LLM Judge=GPT-4o2025.0210