Cultural commonsense reasoning on CultureAtlas Low Resource
Evaluation results
| Method | Links | | | |
|---|
| GPT-42026.01 | | 0.941 | 0.901 | 0.921 |
|---|
| CALM2026.01 | | 0.932 | 0.863 | 0.886 |
|---|
| LLaMA-2Parameters=7B2026.01 | | 0.87 | 0.207 | 0.335 |
|---|
| VicunaParameters=7B2026.01 | | 0.813 | 0.557 | 0.661 |
|---|
| VicunaParameters=13B2026.01 | | 0.678 | 0.823 | 0.743 |
|---|
| LLaMA-2Parameters=13B2026.01 | | 0.533 | 0.205 | 0.296 |
|---|