Natural Language Understanding on MGSM
6.2AccuracyEmbed FT
Evaluation Results
| Method | Links | |
|---|---|---|
| Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 6.2 | |
| LoRABase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 6 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 5.9 | |
| LLaMA-7BBase Model=LLaMA-7B2023.11 | 5.8 | |
| LoRABase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 5.6 | |
| FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.11 | 4.9 | |
| LoRABase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 4.7 | |
| Embed FTBase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 4.7 | |
| FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.11 | 4.5 | |
| Parrot-7BBase Model=Parrot-7B2023.11 | 3.7 | |
| FTBase Model=LLaMA-7B, Training Context=Bilingual2023.11 | 3.4 |