Cultural commonsense reasoning on CultureAtlas Mid Resource
Evaluation results
| Method | Links | | | |
|---|
| GPT-42026.01 | | 94.9 | 92.1 | 93.5 |
|---|
| CALM2026.01 | | 92.5 | 90.3 | 91.2 |
|---|
| LLaMA-2Parameters=7B2026.01 | | 83.3 | 42.9 | 56.6 |
|---|
| VicunaParameters=7B2026.01 | | 79.4 | 57.9 | 67 |
|---|
| VicunaParameters=13B2026.01 | | 69.4 | 82.4 | 75.3 |
|---|
| LLaMA-2Parameters=13B2026.01 | | 64.1 | 75.5 | 69.3 |
|---|