Cultural Alignment Assessment on Cultural alignment dataset
0.79MAEFanarGuard
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FanarGuardSize=4B, Model type=regression model2026.03 | 0.79 | 1.12 | 0.54 | |
| Annotators2026.03 | 0.8 | 1.29 | 0.64 | |
| Qwen2.5-72BSize=72B2026.03 | 0.8 | 1.24 | 0.52 | |
| Qwen3-32BSize=32B2026.03 | 0.9 | 1.57 | 0.47 | |
| gemma-2-27bSize=27b2026.03 | 0.95 | 1.79 | 0.31 | |
| command-r2026.03 | 1 | 1.92 | 0.21 |