Headline Generation on OmniScore Evaluation Set
0.6MAEEttin-150M
Evaluation results
| Method | Links | |
|---|---|---|
| Ettin-150MParams=150M2026.04 | 0.6 | |
| mxbai-largeParams=335M, Context Size=1K2026.04 | 0.61 | |
| DeBERTa-v3Params=86M, Context Size=5122026.04 | 0.64 | |
| mBERT2026.04 | 0.67 | |
| Gemini-3.1-Flash-LiteContext Size=65k2026.04 | 0.89 |