Sentence Completion on IndoCulture
43Sentence Similarity ScoreQwen2.5-7B-IT (+CCKG N-Path)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-7B-IT (+CCKG N-Path)Augmentation=CCKG, Component=Native-language Paths2026.01 | 43 | 72.5 | |
| Qwen2.5-7B-IT (+CCKG E-Path)Augmentation=CCKG, Component=English Paths2026.01 | 42.6 | 72.5 | |
| Qwen2.5-7B-IT (+CCKG E-Asrt)Augmentation=CCKG, Component=English Assertions2026.01 | 42.5 | 72.6 | |
| Qwen2.5-7B-IT (+CCKG N-Asrt)Augmentation=CCKG, Component=Native-language Assertions2026.01 | 42.5 | 72.6 | |
| Qwen2.5-7B-IT (+Mango)Augmentation=Mango (5-shot assertions)2026.01 | 41.7 | 72.3 | |
| Qwen2.5-7B-IT (Before Aug)Augmentation=None (Zero-shot baseline)2026.01 | 39.6 | 72.3 | |
| Llama3.1-8B-IT (+CCKG N-Asrt)Augmentation=CCKG, Component=Native-language Assertions2026.01 | 36.1 | 70.1 | |
| Llama3.1-8B-IT (+CCKG N-Path)Augmentation=CCKG, Component=Native-language Paths2026.01 | 36 | 70 | |
| Gemma2-9B-IT (+CCKG N-Asrt)Augmentation=CCKG, Component=Native-language Assertions2026.01 | 35.5 | 71.5 | |
| Gemma2-9B-IT (+CCKG N-Path)Augmentation=CCKG, Component=Native-language Paths2026.01 | 35.4 | 71.4 | |
| Llama3.1-8B-IT (+CCKG E-Path)Augmentation=CCKG, Component=English Paths2026.01 | 34.9 | 70 | |
| Gemma2-9B-IT (+CCKG E-Path)Augmentation=CCKG, Component=English Paths2026.01 | 34.6 | 71.3 | |
| Gemma2-9B-IT (+CCKG E-Asrt)Augmentation=CCKG, Component=English Assertions2026.01 | 34.4 | 71.3 | |
| Llama3.1-8B-IT (+CCKG E-Asrt)Augmentation=CCKG, Component=English Assertions2026.01 | 34.3 | 69.9 | |
| Llama3.1-8B-IT (+Mango)Augmentation=Mango (5-shot assertions)2026.01 | 33.8 | 69.6 | |
| Gemma2-9B-IT (+Mango)Augmentation=Mango (5-shot assertions)2026.01 | 33.3 | 71 | |
| Llama3.1-8B-IT (Before Aug)Augmentation=None (Zero-shot baseline)2026.01 | 32.6 | 70.2 | |
| Gemma2-9B-IT (Before Aug)Augmentation=None (Zero-shot baseline)2026.01 | 32 | 71.2 |