Story Generation on English Story Generation China
7.8Coherence Rating (CR)Gemma2-9B-IT + CCKG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma2-9B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 7.8 | 9.2 | 8.7 | |
| Llama3.1-8B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 7.3 | 9 | 8.2 | |
| Qwen2.5-7B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 7.3 | 8.9 | 8.5 | |
| Llama3.1-8B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 7 | 8.4 | 7.6 | |
| Qwen2.5-7B-ITAugmentation Method=None (Zero-shot)2026.01 | 7 | 8.7 | 7.9 | |
| Qwen2.5-7B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 6.9 | 8.9 | 7.9 | |
| Gemma2-9B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 6.9 | 9 | 7.8 | |
| Gemma2-9B-ITAugmentation Method=None (Zero-shot)2026.01 | 6.5 | 8.8 | 7.7 | |
| Llama3.1-8B-ITAugmentation Method=None (Zero-shot)2026.01 | 6.3 | 8.4 | 7.6 |