Sentence Completion on ArabCulture native prompts (test)
44.7Avg Sentence SimilarityQwen2.5-7B-IT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (N-Asrt), Prompt=Native prompts2026.01 | 44.7 | 69.5 | |
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (E-Asrt), Prompt=Native prompts2026.01 | 43.9 | 68.8 | |
| Qwen2.5-7B-ITAugmentation Strategy=+Mango, Prompt=Native prompts2026.01 | 42.3 | 68.7 | |
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (N-Path), Prompt=Native prompts2026.01 | 41.9 | 68.7 | |
| Qwen2.5-7B-ITAugmentation Strategy=CCKG (E-Path), Prompt=Native prompts2026.01 | 41.3 | 67.7 | |
| Qwen2.5-7B-ITAugmentation Strategy=Before Aug, Prompt=Native prompts2026.01 | 40.2 | 68.3 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (N-Asrt), Prompt=Native prompts2026.01 | 35.4 | 68.6 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (E-Asrt), Prompt=Native prompts2026.01 | 35 | 68.4 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (N-Path), Prompt=Native prompts2026.01 | 33.2 | 68.3 | |
| Gemma2-9B-ITAugmentation Strategy=CCKG (E-Path), Prompt=Native prompts2026.01 | 32.7 | 68.4 | |
| Llama3.1-8B-ITAugmentation Strategy=+Mango, Prompt=Native prompts2026.01 | 32.4 | 66 | |
| Gemma2-9B-ITAugmentation Strategy=+Mango, Prompt=Native prompts2026.01 | 32.1 | 68.2 | |
| Gemma2-9B-ITAugmentation Strategy=Before Aug, Prompt=Native prompts2026.01 | 31.6 | 68.1 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (E-Asrt), Prompt=Native prompts2026.01 | 30.3 | 65.8 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (N-Asrt), Prompt=Native prompts2026.01 | 28.5 | 65.6 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (E-Path), Prompt=Native prompts2026.01 | 28 | 65 | |
| Llama3.1-8B-ITAugmentation Strategy=Before Aug, Prompt=Native prompts2026.01 | 27.3 | 65 | |
| Llama3.1-8B-ITAugmentation Strategy=CCKG (N-Path), Prompt=Native prompts2026.01 | 27.2 | 65.3 |