List your company
ResearchFormerly WizWand

Question Answering on NaturalQuestions filtered (dev)

44.3EMLlama 2
10.29219.12127.9536.779Jul 18, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Llama 2Size=70B, Shots=64-shot2023.0744.3
Llama 1Size=65B, Shots=64-shot2023.0739.9
Llama 2Size=34B, Shots=64-shot2023.0739.9
Llama 2Size=70B, Shots=5-shot2023.0739.5
Llama 1Size=33B, Shots=64-shot2023.0736
FalconSize=40B, Shots=64-shot2023.0735.5
Llama 1Size=65B, Shots=5-shot2023.0735
Llama 2Size=13B, Shots=64-shot2023.0734.6
FalconSize=40B, Shots=5-shot2023.0733.5
Llama 2Size=70B, Shots=1-shot2023.0733
Llama 1Size=33B, Shots=5-shot2023.0732.9
Llama 2Size=34B, Shots=5-shot2023.0732.8
Llama 1Size=13B, Shots=64-shot2023.0731.9
Llama 2Size=13B, Shots=5-shot2023.0731.2
Llama 1Size=65B, Shots=1-shot2023.0731
Llama 2Size=34B, Shots=1-shot2023.0730
FalconSize=40B, Shots=1-shot2023.0729.5
Llama 2Size=7B, Shots=64-shot2023.0729.5
MPTSize=30B, Shots=64-shot2023.0729.3
Llama 1Size=33B, Shots=1-shot2023.0728.3
Llama 1Size=13B, Shots=5-shot2023.0728.1
Llama 2Size=13B, Shots=1-shot2023.0728
MPTSize=30B, Shots=5-shot2023.0726.6
FalconSize=40B, Shots=0-shot2023.0726.3
Llama 1Size=7B, Shots=64-shot2023.0726.1
Llama 2Size=7B, Shots=5-shot2023.0725.7
Llama 2Size=70B, Shots=0-shot2023.0725.3
Llama 2Size=34B, Shots=0-shot2023.0725.1
Llama 1Size=33B, Shots=0-shot2023.0724.9
FalconSize=7B, Shots=64-shot2023.0724
Llama 1Size=65B, Shots=0-shot2023.0723.8
Llama 1Size=13B, Shots=1-shot2023.0723.4
MPTSize=30B, Shots=1-shot2023.0723
MPTSize=7B, Shots=64-shot2023.0722.7
Llama 2Size=7B, Shots=1-shot2023.0722.7
Llama 1Size=7B, Shots=5-shot2023.0722
FalconSize=7B, Shots=5-shot2023.0721
MPTSize=7B, Shots=5-shot2023.0720.8
Llama 1Size=13B, Shots=0-shot2023.0720.1
Llama 1Size=7B, Shots=1-shot2023.0718.7
FalconSize=7B, Shots=1-shot2023.0718.1
MPTSize=7B, Shots=1-shot2023.0717.8
Llama 1Size=7B, Shots=0-shot2023.0716.8
Llama 2Size=7B, Shots=0-shot2023.0716.4
Llama 2Size=13B, Shots=0-shot2023.0716.1
MPTSize=30B, Shots=0-shot2023.0715.8
FalconSize=7B, Shots=0-shot2023.0715.7
MPTSize=7B, Shots=0-shot2023.0711.6