Cultural commonsense reasoning on CultureAtlas (All Culture)
Evaluation results
| Method | Links | | | |
|---|
| GPT-42026.01 | | 95.8 | 90.6 | 93.1 |
|---|
| CALM2026.01 | | 93.6 | 87.7 | 89.1 |
|---|
| LLaMA-2Parameters=7B2026.01 | | 84.2 | 42.1 | 56.1 |
|---|
| VicunaParameters=7B2026.01 | | 79.6 | 56.8 | 66.3 |
|---|
| VicunaParameters=13B2026.01 | | 67.4 | 81.2 | 73.7 |
|---|
| LLaMA-2Parameters=13B2026.01 | | 63.6 | 77.1 | 69.7 |
|---|