Cultural Specificity Separability on Culture-specific and General sentences
0.963AUCgpt-oss-20b
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gpt-oss-20bEvaluation Method=Baseline2026.02 | 0.963 | 0.78 | |
| gpt-oss-20bEvaluation Method=CCI (Global)2026.02 | 0.956 | 0.773 | |
| Llama-3.1-Swallow-8BEvaluation Method=CCI (Global)2026.02 | 0.945 | 0.437 | |
| llm-jp-3.1-13bEvaluation Method=CCI (Global)2026.02 | 0.908 | 0.301 | |
| Qwen2.5-7BEvaluation Method=CCI (Global)2026.02 | 0.884 | 0.295 | |
| Llama-3.1-Swallow-8BEvaluation Method=Baseline2026.02 | 0.842 | 0.1 | |
| Qwen2.5-7BEvaluation Method=Baseline2026.02 | 0.816 | 0.015 | |
| Llama-3.1-8BEvaluation Method=Baseline2026.02 | 0.803 | 0.07 | |
| Llama-3.1-8BEvaluation Method=CCI (Global)2026.02 | 0.796 | 0.13 | |
| llm-jp-3.1-13bEvaluation Method=Baseline2026.02 | 0.768 | 0.015 |