List your company

Text Summarization Long Q, Short A (test)

31.8ROUGE-1WorldCup
20.3623.3326.329.27Feb 2, 2026

Evaluation results

MethodLinks
WorldCupBackbone=GEMMA2-9B-IT, k=12026.0231.867.162.7
BiMarkBackbone=GEMMA2-9B-IT2026.0231.766.959.8
GEMMA2-9B-ITWatermark=None2026.0231.2——
WorldCupBackbone=GEMMA2-9B-IT, k=22026.0231.266.866.4
MPACBackbone=GEMMA2-9B-IT2026.0230.967.161.9
WorldCupBackbone=LLAMA3.1-8B-IT, k=12026.0226.191.286
LLAMA3.1-8B-ITWatermark=None2026.0224.9——
MPACBackbone=LLAMA3.1-8B-IT2026.0224.98886.9
WorldCupBackbone=LLAMA3.1-8B-IT, k=22026.0224.796.391.9
BiMarkBackbone=LLAMA3.1-8B-IT2026.0224.29689.8
WorldCupBackbone=MINISTRAL-8B-IT, k=12026.0223.196.794.8
MINISTRAL-8B-ITWatermark=None2026.0222.1——
MPACBackbone=MINISTRAL-8B-IT2026.0221.595.192.9
WorldCupBackbone=MINISTRAL-8B-IT, k=22026.0221.398.395.5
BiMarkBackbone=MINISTRAL-8B-IT2026.0220.897.794.3