Cultural Alignment on Prism
4.627RatingCAReDiO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CAReDiOFamily=Gemma-3-27B-IT2025.04 | 4.627 | 100 | |
| Role-PlayFamily=Gemma-3-27B-IT2025.04 | 4.571 | 100 | |
| GPT-5 + Role-PlayFamily=Proprietaty LLMs2025.04 | 4.519 | 100 | |
| CultureParkFamily=Gemma-3-27B-IT2025.04 | 4.474 | 100 | |
| CultureLLMFamily=Gemma-3-27B-IT2025.04 | 4.441 | 100 | |
| CultureSPAFamily=Gemma-3-27B-IT2025.04 | 4.431 | 100 | |
| CAReDiOFamily=GPT-4.12025.04 | 4.336 | 100 | |
| CultureBankFamily=Gemma-3-27B-IT2025.04 | 4.323 | 100 | |
| Role-PlayFamily=GPT-4.12025.04 | 4.27 | 100 | |
| CultureBankFamily=GPT-4.12025.04 | 4.226 | 100 | |
| CultureDataFamily=Gemma-3-27B-IT2025.04 | 4.032 | 100 | |
| CAReDiOFamily=Qwen2.5-7B-Instruct2025.04 | 3.871 | 100 | |
| CultureInstructionFamily=Gemma-3-27B-IT2025.04 | 3.525 | 100 | |
| Role-PlayFamily=Qwen2.5-7B-Instruct2025.04 | 3.364 | 28.5714 | |
| CultureDataFamily=Qwen2.5-7B-Instruct2025.04 | 3.354 | 100 | |
| CultureInstructionFamily=Qwen2.5-7B-Instruct2025.04 | 3.346 | 100 | |
| CultureBankFamily=Qwen2.5-7B-Instruct2025.04 | 3.193 | 100 | |
| CultureLLMFamily=Qwen2.5-7B-Instruct2025.04 | 3.121 | 100 | |
| CultureSPAFamily=Qwen2.5-7B-Instruct2025.04 | 3.108 | 100 | |
| CultureParkFamily=Qwen2.5-7B-Instruct2025.04 | 3.107 | 100 | |
| GPT-5Family=Proprietaty LLMs2025.04 | 2.187 | — | |
| Raw ModelFamily=Gemma-3-27B-IT2025.04 | 2.174 | — | |
| Raw ModelFamily=GPT-4.12025.04 | 2.131 | — | |
| Raw ModelFamily=Qwen2.5-7B-Instruct2025.04 | 2.103 | — |