List your company
ResearchFormerly WizWand

Question Answering on TruthfulQA (PRR Metric)

0.5PRRTAD
-0.128160.034920.1980.36108Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.5
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.485
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.476
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.356
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.322
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.321
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.314
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.306
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.3
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.3
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.274
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.254
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.189
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.185
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.159
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.146
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.137
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.093
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.087
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08-0.018
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08-0.088
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.08-0.104