Story Generation on English Story Generation Egypt
8.9Coherence (CR)Qwen2.5-7B-IT + CCKG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2.5-7B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 8.9 | 9 | 9.2 | |
| Llama3.1-8B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 8.7 | 9.1 | 9.5 | |
| Gemma2-9B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 7.8 | 8.8 | 8.7 | |
| Qwen2.5-7B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 7.3 | 8.9 | 8.8 | |
| Llama3.1-8B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 7 | 9.1 | 8.9 | |
| Qwen2.5-7B-ITAugmentation Method=None (Zero-shot)2026.01 | 7 | 8.9 | 8.8 | |
| Gemma2-9B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 6.8 | 8.6 | 8.6 | |
| Gemma2-9B-ITAugmentation Method=None (Zero-shot)2026.01 | 6.5 | 8.5 | 8.4 | |
| Llama3.1-8B-ITAugmentation Method=None (Zero-shot)2026.01 | 6.3 | 8.9 | 8.7 |