List your company
ResearchFormerly WizWand

Question Answering on TruthfulQA (PRR)

53.5PRRTAD
-1.41212.84427.141.356Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0853.5
MINDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0849
SAPLMABackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0844.9
Semantic DensityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0844.8
LookBackLensBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0843.1
SheepsBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0840.9
LUQBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0835.2
SATRMDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0831.5
Mean Token EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0831
FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0830.6
PerplexityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0827.8
Simple FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0827
SARBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0826
EVL NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0823.6
Ecc. NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0823
DegMat NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0820.6
Lexical Similarity Rouge-LBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0813.7
MSPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0812.6
EigenScoreBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.0810.6
FactoscopeBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.087.7
CCPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.084
Semantic EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.7