List your company
ResearchFormerly WizWand

Instruction Following on AlpacaEval 805 instructions (test)

79.91Win RateLoRA (upper bound)
1.192421.628742.06562.5013Oct 23, 2024
Updated 8mo ago

Evaluation results

MethodLinks
LoRA (upper bound)Base LLM=MISTRAL-7B, Params Add=110M2024.1079.91
LoRA (upper bound)Base LLM=LLAMA2-13B, Params Add=110M2024.1075.16
LoRA (upper bound)Base LLM=LLAMA2-7B, Params Add=110M2024.1068.18
CMCBase LLM=LLAMA2-70B, Params Add=110M, Delta Model=TINYLLAMA-110M, Template Model=LLAMA2-7B2024.1049.81
CMCBase LLM=LLAMA2-13B, Params Add=110M, Delta Model=TINYLLAMA-110M, Template Model=LLAMA2-7B2024.1039.04
CMCBase LLM=MISTRAL-7B, Params Add=110M, Delta Model=TINYLLAMA-110M, Template Model=LLAMA2-7B2024.1033.29
CMCBase LLM=LLAMA2-7B, Params Add=110M, Delta Model=TINYLLAMA-110M, Template Model=LLAMA2-7B2024.1030.41
Vanilla Base ModelBase LLM=LLAMA2-70B, Params Add=02024.1011.55
Proxy-tuningBase LLM=LLAMA2-13B, Params Add=220M, Anti-expert=TINYLLAMA-110M2024.1010.47
Proxy-tuningBase LLM=LLAMA2-70B, Params Add=220M, Anti-expert=TINYLLAMA-110M2024.108.59
Proxy-tuningBase LLM=LLAMA2-7B, Params Add=220M, Anti-expert=TINYLLAMA-110M2024.108.47
Vanilla Base ModelBase LLM=MISTRAL-7B, Params Add=02024.106.83
Vanilla Base ModelBase LLM=LLAMA2-13B, Params Add=02024.105.34
Vanilla Base ModelBase LLM=LLAMA2-7B, Params Add=02024.104.22