Causal Reasoning on IndicCOPA IndicXTREME (test)
45.45Average F1 ScoreIFT
Evaluation Results
| Method | Links | |
|---|---|---|
| IFTScript=Romanized, Shots=0-shot2024.01 | 45.45 | |
| IFTScript=Native, Shots=0-shot2024.01 | 37.3 | |
| CPTScript=Native, Shots=3-shot2024.01 | 35 | |
| BaseLLMScript=Native, Shots=3-shot2024.01 | 25.43 | |
| BaseLLMScript=Native, Shots=1-shot2024.01 | 21.08 | |
| CPTScript=Native, Shots=1-shot2024.01 | 20.47 | |
| CPTScript=Romanized, Shots=3-shot2024.01 | 18.78 | |
| CPTScript=Romanized, Shots=1-shot2024.01 | 18.23 | |
| BaseLLMScript=Romanized, Shots=1-shot2024.01 | 17.53 | |
| BaseLLMScript=Romanized, Shots=3-shot2024.01 | 8.12 |