Question Answering on MultiExpertQA All Base and Fine-tuned (FT)
79AccuracyLlama 2
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama 2#Exp=2, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=70B2025.11 | 79 | |
| Comp-LLM#Exp=2, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=35B2025.11 | 78 | |
| Comp-LLM#Exp=2, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=35B2025.11 | 78 | |
| Comp-LLM#Exp=3, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=42B2025.11 | 76 | |
| Comp-LLM#Exp=3, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=42B2025.11 | 76 | |
| Llama 2#Exp=3, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=70B2025.11 | 74 | |
| Llama 2#Exp=2, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=34B2025.11 | 73 | |
| Llama 2#Exp=2, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=34B2025.11 | 69 | |
| Llama 2#Exp=3, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=34B2025.11 | 65 | |
| Comp-LLM#Exp=2, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=3.65B2025.11 | 62 | |
| Comp-LLM#Exp=2, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=3.65B2025.11 | 62 | |
| Llama 2#Exp=3, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=62B2025.11 | 62 | |
| Llama 2#Exp=2, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=13B2025.11 | 61 | |
| Llama 2#Exp=3, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=13B2025.11 | 61 | |
| OPT#Exp=2, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=13B2025.11 | 58 | |
| Comp-LLM#Exp=3, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=4B2025.11 | 58 | |
| OPT#Exp=3, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=13B2025.11 | 58 | |
| Comp-LLM#Exp=3, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=4B2025.11 | 58 | |
| OPT#Exp=2, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=13B2025.11 | 57 | |
| Llama 2#Exp=2, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=13B2025.11 | 56 | |
| Llama 2#Exp=3, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=13B2025.11 | 55 | |
| Llama 2#Exp=2, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=7B2025.11 | 54 | |
| Llama 2#Exp=2, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=7B2025.11 | 54 | |
| OPT#Exp=3, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=13B2025.11 | 54 | |
| OPT#Exp=2, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=6.7B2025.11 | 53 | |
| OPT#Exp=2, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=6.7B2025.11 | 52 | |
| OPT#Exp=3, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=6.7B2025.11 | 52 | |
| OPT#Exp=3, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=6.7B2025.11 | 49 | |
| Llama 2#Exp=3, Expert Variant=FT, Model Family=Llama 2, Model Scale (Parameter Count)=7B2025.11 | 47 | |
| Llama 2#Exp=2, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=7B2025.11 | 45 | |
| Llama 2#Exp=3, Expert Variant=Base, Model Family=Llama 2, Model Scale (Parameter Count)=7B2025.11 | 41 | |
| OPT#Exp=2, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=1.3B2025.11 | 34 | |
| OPT#Exp=3, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=1.3B2025.11 | 31 | |
| OPT#Exp=2, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=1.3B2025.11 | 29 | |
| OPT#Exp=2, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=350M2025.11 | 29 | |
| OPT#Exp=2, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=125M2025.11 | 28 | |
| OPT#Exp=3, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=350M2025.11 | 27 | |
| OPT#Exp=3, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=1.3B2025.11 | 25 | |
| OPT#Exp=2, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=350M2025.11 | 24 | |
| OPT#Exp=3, Expert Variant=FT, Model Family=OPT, Model Scale (Parameter Count)=125M2025.11 | 23 | |
| OPT#Exp=3, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=350M2025.11 | 22 | |
| OPT#Exp=2, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=125M2025.11 | 19 | |
| OPT#Exp=3, Expert Variant=Base, Model Family=OPT, Model Scale (Parameter Count)=125M2025.11 | 15 |