Natural Language Understanding on XCOPA 1.0 (test)
54.5AccuracyFT
Evaluation Results
| Method | Links | |
|---|---|---|
| FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 54.5 | |
| LoRABase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 54.5 | |
| LoRABase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 54.4 | |
| FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 54.4 | |
| LoRABase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 54.3 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 54.3 | |
| Parrot-7BBase Model=Parrot-7B2023.11 | 54.2 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 54.1 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 54 | |
| LLaMA-7BBase Model=LLaMA-7B2023.11 | 53.9 | |
| FTBase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 53.9 |