List your company
ResearchFormerly WizWand

Claim-level Uncertainty Quantification on FactScore English (test)

71ROC-AUCCCP
52.2857.146266.86Mar 7, 2024
Updated 8mo ago

Evaluation results

MethodLinks
CCPBase LLM=Jais 13b2024.0371
CCPBase LLM=Mistral 7b2024.0366
CCPBase LLM=Vicuna 13b2024.0366
Maximum Prob.Base LLM=Jais 13b2024.0364
Token EntropyBase LLM=Jais 13b2024.0363
PerplexityBase LLM=Jais 13b2024.0361
P(True)Base LLM=Vicuna 13b2024.0361
Maximum Prob.Base LLM=Vicuna 13b2024.0360
Token EntropyBase LLM=Mistral 7b2024.0360
Token EntropyBase LLM=Vicuna 13b2024.0360
Maximum Prob.Base LLM=Mistral 7b2024.0359
CCPBase LLM=GPT-3.5-turbo2024.0358
PerplexityBase LLM=Mistral 7b2024.0358
PerplexityBase LLM=Vicuna 13b2024.0358
P(True)Base LLM=Jais 13b2024.0355
Maximum Prob.Base LLM=GPT-3.5-turbo2024.0354
PerplexityBase LLM=GPT-3.5-turbo2024.0353
Token EntropyBase LLM=GPT-3.5-turbo2024.0353
P(True)Base LLM=Mistral 7b2024.0353
P(True)Base LLM=GPT-3.5-turbo2024.0353