List your company
ResearchFormerly WizWand

Natural Language Understanding on XCOPA 1.0 (test)

54.5AccuracyFT
53.87654.03854.254.362Nov 15, 2023
Updated 8mo ago

Evaluation results

MethodLinks
FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.1154.5
LoRABase Model=LLaMA-7B, Training Context=Alpaca-X2023.1154.5
LoRABase Model=LLaMA-7B, Training Context=Alpaca-En2023.1154.4
FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.1154.4
LoRABase Model=LLaMA-7B, Training Context=Bilingual2023.1154.3
Embed FTBase Model=LLaMA-7B, Training Context=Bilingual2023.1154.3
Parrot-7BBase Model=Parrot-7B2023.1154.2
Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-X2023.1154.1
Embed FTBase Model=LLaMA-7B, Training Context=Alpaca-En2023.1154
LLaMA-7BBase Model=LLaMA-7B2023.1153.9
FTBase Model=LLaMA-7B, Training Context=Bilingual2023.1153.9