Readability Scoring on German ESG reports (eval)
0.0264MSESyntax + XLM-base
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Syntax + XLM-baseType=Combinations, Ø Time per Sentence=0.0296s, # Params=∼279M2026.03 | 0.0264 | 0.1141 | 0.1676 | |
| Syntax + XLM-base + QwenType=Combinations, Ø Time per Sentence=0.0799s, # Params=∼4,279M2026.03 | 0.0292 | 0.1355 | 0.2627 | |
| XLM-RoBERTa baseType=XLM-RoBERTa, Ø Time per Sentence=0.0035s, # Params=∼278M2026.03 | 0.0295 | 0.1114 | 0.2461 | |
| XLM-base + QwenType=Combinations, Ø Time per Sentence=0.0538s, # Params=∼4,278M2026.03 | 0.0358 | 0.1432 | 0.2857 | |
| Syntactic featuresType=Whitebox, Ø Time per Sentence=0.0261s, # Params=∼0.7M2026.03 | 0.0389 | 0.1502 | 0.0534 | |
| Readability formulae baselineType=Whitebox, Ø Time per Sentence=0.0018s, # Params=52026.03 | 0.0394 | 0.1588 | 0.0863 | |
| Syntax + QwenType=Combinations, Ø Time per Sentence=0.0764s, # Params=∼4,001M2026.03 | 0.0485 | 0.1777 | 0.2304 | |
| Qwen 3 4B Instruct 2507Type=LLMs, Ø Time per Sentence=0.0503s, # Params=∼4,000M2026.03 | 0.1119 | 0.2469 | 0.2822 | |
| XLM-RoBERTa largeType=XLM-RoBERTa, # Params=∼550M2026.03 | 0.1325 | 0.3373 | 0.2198 | |
| Sentence length baselineType=Whitebox, Ø Time per Sentence=0.0003s, # Params=12026.03 | 0.1859 | 0.4017 | 0.229 | |
| Llama 3 8B instructType=LLMs, Ø Time per Sentence=0.7100s, # Params=∼8,000M2026.03 | 0.2347 | 0.423 | 0.1906 | |
| Gemma 3 4B itType=LLMs, Ø Time per Sentence=0.3110s, # Params=∼4,000M2026.03 | 0.2396 | 0.4402 | 0.0448 |