Natural Language Understanding on PAW-X
57.1AccuracyFT
Evaluation results
| Method | Links | |
|---|---|---|
| FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 57.1 | |
| FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 57.1 | |
| Parrot-7BBase Model=Parrot-7B2023.11 | 56.5 | |
| FTBase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 55.9 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 54.6 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 54.4 | |
| LoRABase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 54.3 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 54.3 | |
| LoRABase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 54.1 | |
| LoRABase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 53.8 | |
| LLaMA-7BBase Model=LLaMA-7B2023.11 | 53.2 |