List your company
ResearchFormerly WizWand

Truthfulness Evaluation on TruthfulQA

16.9Reliability ScoreAligner
-1.9242.9637.8512.737Feb 4, 2024
Updated 6mo ago

Evaluation results

MethodLinks
AlignerAligner size=13B, Upstream LLM=Alpaca-7B, Zero-shot=true2024.0216.9——
AlignerAligner size=13B, Upstream LLM=Beaver-7B, Zero-shot=true2024.0213——
AlignerAligner size=7B, Upstream LLM=Alpaca-7B, Zero-shot=true2024.0211.8——
AlignerAligner size=2B, Upstream LLM=Llama2-70B-Chat, Zero-shot=true2024.0210.8——
AlignerAligner size=7B, Upstream LLM=Beaver-7B, Zero-shot=true2024.0210.3——
AlignerAligner size=13B, Upstream LLM=Llama2-70B-Chat, Zero-shot=true2024.0210.3——
AlignerAligner size=2B, Upstream LLM=Alpaca-7B, Zero-shot=true2024.0210——
AlignerAligner size=7B, Upstream LLM=Llama2-70B-Chat, Zero-shot=true2024.029.1——
AlignerAligner size=2B, Upstream LLM=Vicuna-13B, Zero-shot=true2024.027.6——
AlignerAligner size=13B, Upstream LLM=Vicuna-13B, Zero-shot=true2024.027.1——
AlignerAligner size=13B, Upstream LLM=Vicuna-7B, Zero-shot=true2024.026.6——
AlignerAligner size=13B, Upstream LLM=Vicuna-33B, Zero-shot=true2024.026.1——
AlignerAligner size=2B, Upstream LLM=Beaver-7B, Zero-shot=true2024.025.4——
AlignerAligner size=2B, Upstream LLM=Vicuna-33B, Zero-shot=true2024.025.1——
AlignerAligner size=2B, Upstream LLM=Vicuna-7B, Zero-shot=true2024.024.9——
AlignerAligner size=13B, Upstream LLM=Llama2-7B-Chat, Zero-shot=true2024.024.2——
AlignerAligner size=2B, Upstream LLM=Llama2-7B-Chat, Zero-shot=true2024.023.9——
AlignerAligner size=7B, Upstream LLM=Vicuna-33B, Zero-shot=true2024.023.2——
AlignerAligner size=7B, Upstream LLM=Vicuna-7B, Zero-shot=true2024.022.7——
AlignerAligner size=7B, Upstream LLM=Vicuna-13B, Zero-shot=true2024.022.7——
AlignerAligner size=7B, Upstream LLM=Claude 2, Zero-shot=true2024.022——
AlignerAligner size=7B, Upstream LLM=Llama2-13B-Chat, Zero-shot=true2024.021.7——
AlignerAligner size=7B, Upstream LLM=Llama2-7B-Chat, Zero-shot=true2024.021.5——
AlignerAligner size=2B, Upstream LLM=Llama2-13B-Chat, Zero-shot=true2024.021.2——
AlignerAligner size=13B, Upstream LLM=Llama2-13B-Chat, Zero-shot=true2024.021——
AlignerAligner size=2B, Upstream LLM=GPT-3.5, Zero-shot=true2024.020.7——
AlignerAligner size=2B, Upstream LLM=Claude 2, Zero-shot=true2024.020.7——
AlignerAligner size=13B, Upstream LLM=GPT-3.5, Zero-shot=true2024.020.5——
AlignerAligner size=13B, Upstream LLM=Claude 2, Zero-shot=true2024.020.5——
AlignerAligner size=7B, Upstream LLM=GPT-3.5, Zero-shot=true2024.020——
AlignerAligner size=13B, Upstream LLM=GPT-4, Zero-shot=true2024.02-0.2——
AlignerAligner size=2B, Upstream LLM=GPT-4, Zero-shot=true2024.02-0.5——
AlignerAligner size=7B, Upstream LLM=GPT-4, Zero-shot=true2024.02-1.2——
CBS2025.05—6498
Falcon InstructParameter Count=7B2024.02—27.2—
Gemma-2BParameters=2B2024.07—44—
GIFTModel Size=7B2025.10—69.05—
GIFTModel Size=32B2025.10—70.02—
GRPOModel Size=7B2025.10—66.93—
GRPOModel Size=32B2025.10—69.09—
InstructModel Size=7B2025.10—64.79—
InstructModel Size=32B2025.10—65.58—
Llama-2-ChatParameter Count=7B2024.02—26.3—
Mistral-7BParameters=7B2024.07—41—
MPT ChatParameter Count=7B2024.02—42.7—
OLMo (base)Parameter Count=7B2024.02—31.6—
OLMo+SFTParameter Count=7B2024.02—41.2—
OLMo+SFT+DPOParameter Count=7B2024.02—52—
Phi-2Parameters=2.7B2024.07—42—
Phi-2 + BiasDPOParameters=2.7B, Alignment=BiasDPO2024.07—45—
Re-Control2025.05—7499
RPJ-INCITE ChatParameter Count=7B2024.02—53—
SEA2025.05—7699
SFT2025.05—62100
StableLM-3BParameters=3B2024.07—36—
TÜLU 2Parameter Count=7B2024.02—51.7—