Cultural Alignment on GlobalOpinionQA
60.08AccuracyGPT-5 + Role-Play
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| GPT-5 + Role-PlayFamily=Proprietaty LLMs2025.04 | 60.08 | 100 | — | — | — | — | — | |
| CultureParkFamily=Gemma-3-27B-IT2025.04 | 59.74 | 85.7143 | — | — | — | — | — | |
| CultureInstructionFamily=Gemma-3-27B-IT2025.04 | 59.22 | 92.8571 | — | — | — | — | — | |
| CultureDataFamily=Gemma-3-27B-IT2025.04 | 58.33 | 85.7143 | — | — | — | — | — | |
| CAReDiOFamily=Gemma-3-27B-IT2025.04 | 58.25 | 92.8571 | — | — | — | — | — | |
| CultureLLMFamily=Gemma-3-27B-IT2025.04 | 58.15 | 71.4286 | — | — | — | — | — | |
| CultureInstructionFamily=Qwen2.5-7B-Instruct2025.04 | 57.78 | 100 | — | — | — | — | — | |
| CultureDataFamily=Qwen2.5-7B-Instruct2025.04 | 57.44 | 100 | — | — | — | — | — | |
| CultureLLMFamily=Qwen2.5-7B-Instruct2025.04 | 57.11 | 85.7143 | — | — | — | — | — | |
| CultureBankFamily=GPT-4.12025.04 | 56.76 | 100 | — | — | — | — | — | |
| CAReDiOFamily=GPT-4.12025.04 | 56.64 | 92.8571 | — | — | — | — | — | |
| CultureSPAFamily=Gemma-3-27B-IT2025.04 | 56.59 | 78.5714 | — | — | — | — | — | |
| CultureParkFamily=Qwen2.5-7B-Instruct2025.04 | 56.47 | 78.5714 | — | — | — | — | — | |
| CultureBankFamily=Qwen2.5-7B-Instruct2025.04 | 56.43 | 92.8571 | — | — | — | — | — | |
| CAReDiOFamily=Qwen2.5-7B-Instruct2025.04 | 56.23 | 85.7143 | — | — | — | — | — | |
| CultureBankFamily=Gemma-3-27B-IT2025.04 | 55.89 | 64.2857 | — | — | — | — | — | |
| Role-PlayFamily=Qwen2.5-7B-Instruct2025.04 | 55.83 | 92.8571 | — | — | — | — | — | |
| Role-PlayFamily=Gemma-3-27B-IT2025.04 | 54.84 | 71.4286 | — | — | — | — | — | |
| Role-PlayFamily=GPT-4.12025.04 | 53.76 | 64.2857 | — | — | — | — | — | |
| Raw ModelFamily=Qwen2.5-7B-Instruct2025.04 | 53.28 | — | — | — | — | — | — | |
| CultureSPAFamily=Qwen2.5-7B-Instruct2025.04 | 52.83 | 42.8571 | — | — | — | — | — | |
| Raw ModelFamily=GPT-4.12025.04 | 52.69 | — | — | — | — | — | — | |
| Raw ModelFamily=Gemma-3-27B-IT2025.04 | 51.83 | — | — | — | — | — | — | |
| GPT-5Family=Proprietaty LLMs2025.04 | 46.27 | — | — | — | — | — | — | |
| Global RMBase Model=OpenAssistant2026.06 | — | — | 83.04 | 82.1 | 83.97 | 82.85 | 82.99 | |
| GPOBase Model=OpenAssistant2026.06 | — | — | 83.16 | 82.78 | 83.42 | 83.73 | 83.27 | |
| SCPOBase Model=OpenAssistant2026.06 | — | — | 92.57 | 81.76 | 92.53 | 91.87 | 89.68 |