Story Generation on Native Story Generation Egypt
7Cultural RelevanceGemma2-9B-IT + Mango
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma2-9B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 7 | 7.7 | 4.8 | |
| Gemma2-9B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.9 | 7.7 | 5.2 | |
| Qwen2.5-7B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.7 | 7.4 | 5.8 | |
| Llama3.1-8B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.6 | 7.2 | 4.8 | |
| Llama3.1-8B-IT + CCKGAugmentation=CCKG, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.6 | 6.9 | 4.8 | |
| Qwen2.5-7B-IT + MangoAugmentation=Mango, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.6 | 7.5 | 5.2 | |
| Gemma2-9B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 6.5 | 8.3 | 5.5 | |
| Gemma2-9B-ITAugmentation=Mango2026.01 | 6.4 | 5 | 5.1 | |
| Gemma2-9B-ITAugmentation=CCKG2026.01 | 6.3 | 5 | 5.3 | |
| Llama3.1-8B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 5.9 | 7.3 | 4.6 | |
| Gemma2-9B-ITAugmentation=None2026.01 | 5.8 | 5.2 | 5.1 | |
| Qwen2.5-7B-ITAugmentation=None, Evaluation Protocol=GPT-4o as Judge2026.01 | 5.8 | 7.8 | 5.6 | |
| Gemma2-9B-ITAugmentation=CCKG2026.01 | 5.4 | 5.4 | 6.1 | |
| Gemma2-9B-ITAugmentation=Mango2026.01 | 4.9 | 5.2 | 5.6 | |
| Gemma2-9B-ITAugmentation=None2026.01 | 4.7 | 5.1 | 5.1 | |
| Qwen2.5-7B-ITAugmentation=CCKG2026.01 | 4.5 | 2.7 | 3 | |
| Qwen2.5-7B-ITAugmentation=Mango2026.01 | 4.3 | 2.9 | 3 | |
| Qwen2.5-7B-ITAugmentation=None2026.01 | 3.9 | 3.4 | 3.2 | |
| Qwen2.5-7B-ITAugmentation=None2026.01 | 3 | 3 | 3.3 | |
| Qwen2.5-7B-ITAugmentation=CCKG2026.01 | 2.8 | 2.6 | 2.8 | |
| Qwen2.5-7B-ITAugmentation=Mango2026.01 | 2.6 | 2.4 | 2.5 | |
| Llama3.1-8B-ITAugmentation=Mango2026.01 | 2 | 1.8 | 1.7 | |
| Llama3.1-8B-ITAugmentation=None2026.01 | 1.9 | 2.1 | 1.9 | |
| Llama3.1-8B-ITAugmentation=CCKG2026.01 | 1.9 | 1.6 | 1.7 | |
| Llama3.1-8B-ITAugmentation=Mango2026.01 | 1.8 | 1.8 | 1.5 | |
| Llama3.1-8B-ITAugmentation=CCKG2026.01 | 1.8 | 1.6 | 1.5 | |
| Llama3.1-8B-ITAugmentation=None2026.01 | 1.6 | 1.8 | 1.6 |