Story Generation on Native Story Generation Indonesia
8.5Cultural RelevanceGemma2-9B-IT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma2-9B-ITAugmentation=Mango2026.01 | 8.5 | 8.9 | 8.1 | |
| Gemma2-9B-ITAugmentation=CCKG2026.01 | 8.3 | 8.9 | 8.5 | |
| Gemma2-9B-ITAugmentation=None2026.01 | 8.2 | 9.3 | 8.4 | |
| Gemma2-9B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.7 | 7.8 | 5.2 | |
| Gemma2-9B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.5 | 8.1 | 5.8 | |
| Gemma2-9B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 7.5 | 8.1 | 5.8 | |
| Gemma2-9B-ITAugmentation=CCKG2026.01 | 7.2 | 7.4 | 7.3 | |
| Qwen2.5-7B-ITAugmentation=Mango2026.01 | 7.2 | 7.4 | 7.1 | |
| Qwen2.5-7B-ITAugmentation=CCKG2026.01 | 7.2 | 7.7 | 7.5 | |
| Qwen2.5-7B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.9 | 7.5 | 5.9 | |
| Llama3.1-8B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.8 | 6.7 | 4.5 | |
| Qwen2.5-7B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.8 | 7.2 | 4.8 | |
| Llama3.1-8B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.7 | 6.9 | 4.8 | |
| Gemma2-9B-ITAugmentation=None2026.01 | 6.6 | 8.3 | 7.4 | |
| Qwen2.5-7B-ITAugmentation=CCKG2026.01 | 6.5 | 6.9 | 6.6 | |
| Llama3.1-8B-ITAugmentation=CCKG2026.01 | 6.4 | 5.6 | 4.6 | |
| Llama3.1-8B-ITAugmentation=CCKG2026.01 | 6.3 | 6.5 | 6.4 | |
| Llama3.1-8B-ITAugmentation=Mango2026.01 | 6.3 | 5.8 | 4.7 | |
| Qwen2.5-7B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.3 | 7.6 | 5.8 | |
| Qwen2.5-7B-ITAugmentation=None2026.01 | 6.2 | 6.9 | 6.4 | |
| Llama3.1-8B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.2 | 7.1 | 4.5 | |
| Gemma2-9B-ITAugmentation=Mango2026.01 | 6.1 | 7.2 | 6.4 | |
| Qwen2.5-7B-ITAugmentation=None2026.01 | 5.8 | 6.2 | 6.1 | |
| Llama3.1-8B-ITAugmentation=Mango2026.01 | 5.4 | 5.9 | 5.5 | |
| Qwen2.5-7B-ITAugmentation=Mango2026.01 | 5.4 | 6.4 | 6.2 | |
| Llama3.1-8B-ITAugmentation=None2026.01 | 5.4 | 5.5 | 4.4 | |
| Llama3.1-8B-ITAugmentation=None2026.01 | 4.7 | 4.9 | 4.6 |