Story Generation on Native Story Generation China (native)
8.6Cultural RelevanceGemma2-9B-IT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma2-9B-ITAugmentation=None2026.01 | 8.6 | 9.6 | 8.8 | |
| Qwen2.5-7B-ITAugmentation=Mango2026.01 | 8.5 | 7.5 | 8.1 | |
| Qwen2.5-7B-ITAugmentation=CCKG2026.01 | 8.5 | 7.5 | 7.9 | |
| Gemma2-9B-ITAugmentation=Mango2026.01 | 8.4 | 8.6 | 8 | |
| Gemma2-9B-ITAugmentation=CCKG2026.01 | 8 | 8.5 | 8.3 | |
| Llama3.1-8B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.9 | 6.1 | 4.2 | |
| Qwen2.5-7B-ITAugmentation=None2026.01 | 7.7 | 6.8 | 8.2 | |
| Gemma2-9B-ITAugmentation=Mango2026.01 | 7.7 | 7.4 | 7.7 | |
| Gemma2-9B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.7 | 7.7 | 6.1 | |
| Qwen2.5-7B-ITAugmentation=CCKG2026.01 | 7.6 | 7.8 | 7.7 | |
| Gemma2-9B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.6 | 8 | 5.4 | |
| Gemma2-9B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.6 | 7.2 | 5.2 | |
| Qwen2.5-7B-ITAugmentation=Mango2026.01 | 7.5 | 7.9 | 7.2 | |
| Gemma2-9B-ITAugmentation=None2026.01 | 7.4 | 7.4 | 7.9 | |
| Gemma2-9B-ITAugmentation=CCKG2026.01 | 7.4 | 6.8 | 7.2 | |
| Qwen2.5-7B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.4 | 8 | 6.4 | |
| Llama3.1-8B-ITAugmentation=Mango2026.01 | 7.2 | 6.9 | 5.6 | |
| Llama3.1-8B-ITAugmentation=CCKG2026.01 | 7.2 | 6 | 5.2 | |
| Qwen2.5-7B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.8 | 8.1 | 4.9 | |
| Qwen2.5-7B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.7 | 8.2 | 7.3 | |
| Qwen2.5-7B-ITAugmentation=None2026.01 | 6.6 | 7.2 | 6.8 | |
| Llama3.1-8B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.3 | 6.6 | 4.5 | |
| Llama3.1-8B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 6 | 7.6 | 4.8 | |
| Llama3.1-8B-ITAugmentation=None2026.01 | 5.6 | 7 | 4.8 | |
| Llama3.1-8B-ITAugmentation=CCKG2026.01 | 3.9 | 3.7 | 3.8 | |
| Llama3.1-8B-ITAugmentation=None2026.01 | 3.6 | 3.8 | 3.4 | |
| Llama3.1-8B-ITAugmentation=Mango2026.01 | 3.5 | 3.2 | 3 |