Text Summarization Hallucination Evaluation on XSum
19AccuracyMEAP
Evaluation results
| Method | Links | |
|---|---|---|
| MEAPTraining Objective=Mask-Enhanced Autoregressive Prediction, LLM Judge=Qwen-Plus2025.02 | 19 | |
| NTPTraining Objective=Next Token Prediction, LLM Judge=Qwen-Plus2025.02 | 16 | |
| MEAPTraining Objective=Mask-Enhanced Autoregressive Prediction, LLM Judge=GPT-4o2025.02 | 16 | |
| NTPTraining Objective=Next Token Prediction, LLM Judge=GPT-4o2025.02 | 14 | |
| MEAPTraining Objective=Mask-Enhanced Autoregressive Prediction, LLM Judge=Deepseek-V32025.02 | 13 | |
| NTPTraining Objective=Next Token Prediction, LLM Judge=Deepseek-V32025.02 | 9 |