List your company

Summarization on XSUM (Win Rate)

80Win RateMultiMetric
37.3648.4359.570.57May 26, 2026

Evaluation results

MethodLinks
MultiMetricModel=GPT-J, Baseline Comparison=MPO2026.0580
MultiMetricModel=LLaMA, Baseline Comparison=MPO2026.0554
MultiMetricModel=DeepSeek, Baseline Comparison=MPO2026.0552.4
MultiMetricModel=BART, Baseline Comparison=MPO2026.0552
MultiMetricModel=BART, Baseline Comparison=SFT2026.0551.4
MultiMetricModel=GPT-J, Baseline Comparison=SFT2026.0544.2
MultiMetricModel=LLaMA, Baseline Comparison=SFT2026.0542
MultiMetricModel=DeepSeek, Baseline Comparison=SFT2026.0539