Cultural Reasoning on CultureScope (CS) (test)
84.38AccuracyC-Mining
Evaluation Results
| Method | Links | |
|---|---|---|
| C-MiningBackbone=Qwen3-32B, Instruction Tuning Method=C-Mining2026.04 | 84.38 | |
| C-MiningBackbone=Qwen2.5-7B, Instruction Tuning Method=C-Mining2026.04 | 82.65 | |
| CultureBankBackbone=Qwen2.5-7B, Instruction Tuning Method=CultureBank2026.04 | 82.56 | |
| CultureSPABackbone=Qwen2.5-7B, Instruction Tuning Method=CultureSPA2026.04 | 82.23 | |
| Qwen3-32BBackbone=Qwen3-32B, Instruction Tuning Method=Standard2026.04 | 82.07 | |
| Qwen2.5-7BBackbone=Qwen2.5-7B, Instruction Tuning Method=Standard2026.04 | 80.64 | |
| CultureLLMBackbone=Qwen2.5-7B, Instruction Tuning Method=CultureLLM2026.04 | 77.75 | |
| Llama3.1-8BBackbone=Llama3.1-8B, Instruction Tuning Method=Standard2026.04 | 76.18 | |
| Ministral3-8BBackbone=Ministral3-8B, Instruction Tuning Method=Standard2026.04 | 75.64 | |
| GLM4-9BBackbone=GLM4-9B, Instruction Tuning Method=Standard2026.04 | 74.71 |