Cultural Commonsense Reasoning on CultureAtlas High Resource
Evaluation results
| Method | Links | | | |
|---|
| GPT-42026.01 | | 95.9 | 91.4 | 93.6 |
|---|
| CALM2026.01 | | 95 | 90.9 | 92.4 |
|---|
| LLaMA-2Parameters=7B2026.01 | | 86.8 | 45.6 | 59.8 |
|---|
| VicunaParameters=7B2026.01 | | 77.3 | 47.2 | 58.6 |
|---|
| VicunaParameters=13B2026.01 | | 68.9 | 81 | 74.5 |
|---|
| LLaMA-2Parameters=13B2026.01 | | 56.1 | 80.9 | 66.3 |
|---|