Sentence Completion on IndoCulture native prompts (test)
42Avg Sentence SimilarityQwen2.5-7B-IT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (E-Asrt), Prompt=Native prompts2026.01 | 42 | 71.9 | |
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (E-Path), Prompt=Native prompts2026.01 | 41.7 | 71.9 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (N-Path), Prompt=Native prompts2026.01 | 41.6 | 72.1 | |
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (N-Asrt), Prompt=Native prompts2026.01 | 41.5 | 72 | |
| Qwen2.5-7B-ITAugmentation Strategy=+Mango, Prompt=Native prompts2026.01 | 41.1 | 71.9 | |
| Qwen2.5-7B-ITAugmentation Strategy=Before Aug, Prompt=Native prompts2026.01 | 39.8 | 71.9 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (N-Path), Prompt=Native prompts2026.01 | 35 | 71.4 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (N-Asrt), Prompt=Native prompts2026.01 | 35 | 70.2 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (N-Asrt), Prompt=Native prompts2026.01 | 34.6 | 71.3 | |
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (N-Path), Prompt=Native prompts2026.01 | 34.4 | 70.1 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (E-Path), Prompt=Native prompts2026.01 | 34.4 | 70 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (E-Asrt), Prompt=Native prompts2026.01 | 34 | 71.1 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (E-Path), Prompt=Native prompts2026.01 | 34 | 71.1 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (E-Asrt), Prompt=Native prompts2026.01 | 33.8 | 70.2 | |
| Llama3.1-8B-ITAugmentation Strategy=+Mango, Prompt=Native prompts2026.01 | 33.6 | 70 | |
| Gemma2-9B-ITAugmentation Strategy=+Mango, Prompt=Native prompts2026.01 | 33.2 | 70.8 | |
| Gemma2-9B-ITAugmentation Strategy=Before Aug, Prompt=Native prompts2026.01 | 31.3 | 70.5 | |
| Llama3.1-8B-ITAugmentation Strategy=Before Aug, Prompt=Native prompts2026.01 | 31.1 | 69.6 |