List your company

Factual Knowledge Evaluation on DyKnow 130 time-sensitive facts Wikidata-derived

80CorrectnessGPT-4
8.2426.8745.564.13Jan 22, 2025

Evaluation results

MethodLinks
GPT-4Year=2023, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.0180137
Llama-3 InstructYear=2024, Model Variant=Instruct, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.01761410
Mixtral InstructYear=2023, Model Variant=Instruct, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.0162299
Llama-3Year=2024, Evaluation Protocol=Upper Bound2025.0157367
ChatGPTYear=2022, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.0157358
MistralYear=2023, Evaluation Protocol=Upper Bound2025.0153398
VicunaYear=2023, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.01523315
Mistral InstructYear=2023, Model Variant=Instruct, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.01523216
Llama-2Year=2023, Evaluation Protocol=Upper Bound2025.0151427
Llama-2 ChatYear=2023, Model Variant=Chat, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.01513712
MixtralYear=2023, Evaluation Protocol=Upper Bound2025.01484210
Falcon InstructYear=2023, Model Variant=Instruct, Prompting Prefix=Answer with the name only, Evaluation Protocol=Upper Bound2025.01444115
GPT-3Year=2020, Evaluation Protocol=Upper Bound2025.01424712
FalconYear=2023, Evaluation Protocol=Upper Bound2025.01424711
OpenELM 3BYear=2024, Evaluation Protocol=Upper Bound2025.01424216
GPT-JYear=2021, Evaluation Protocol=Upper Bound2025.01414613
OLMo 1BYear=2024, Evaluation Protocol=Upper Bound2025.01374023
BloomYear=2022, Evaluation Protocol=Upper Bound2025.01354916
OLMo 7BYear=2024, Evaluation Protocol=Upper Bound2025.01353629
OpenELM 1.1BYear=2024, Evaluation Protocol=Upper Bound2025.01354718
GPT-2Year=2019, Evaluation Protocol=Upper Bound2025.01264232
Flan-T5Year=2022, Evaluation Protocol=Upper Bound2025.01183943
OpenELM 270MYear=2024, Evaluation Protocol=Upper Bound2025.01122861
T5Year=2020, Evaluation Protocol=Upper Bound2025.01112168