Story Generation on English Story Generation Indonesia
8Cultural RelevanceGemma2-9B-IT + CCKG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma2-9B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 8 | 8.9 | 8.8 | |
| Llama3.1-8B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 7.7 | 8.4 | 8.3 | |
| Gemma2-9B-ITAugmentation Method=None (Zero-shot)2026.01 | 7.6 | 8.7 | 8.4 | |
| Qwen2.5-7B-IT + CCKGAugmentation Method=CCKG (1-shot paths)2026.01 | 7.3 | 8.3 | 7.9 | |
| Llama3.1-8B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 7 | 8.3 | 8 | |
| Llama3.1-8B-ITAugmentation Method=None (Zero-shot)2026.01 | 6.9 | 8.1 | 7.7 | |
| Gemma2-9B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 6.9 | 8.5 | 8.1 | |
| Qwen2.5-7B-IT + MangoAugmentation Method=Mango (5-shot assertions)2026.01 | 6.8 | 8.3 | 7.7 | |
| Qwen2.5-7B-ITAugmentation Method=None (Zero-shot)2026.01 | 6.6 | 7.5 | 7.2 |