List your company
ResearchFormerly WizWand

Question Answering on TriviaQA (PRR)

66.5PRRTAD
39.56446.55753.5560.543Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0866.5
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0866.3
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0862.3
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0862
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0861
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0860.8
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0860.3
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0860.3
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0860.1
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0859.6
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0858.5
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0858.5
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0858
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0857.4
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0857.1
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0856.8
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0854.3
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0853.6
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0853.1
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0850
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0849.7
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0840.6