List your company
ResearchFormerly WizWand

Conversational Question Answering on CoQA (PRR)

40.7PRRTAD
-1.5249.43820.431.362Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0840.7
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0838.6
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0835.7
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0835.2
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0834.6
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0833.7
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0832.9
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0832.9
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0832.1
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0831.8
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0831.5
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0829.7
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0829.4
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0829.1
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0828.1
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0827
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0826.5
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0826.3
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0824.9
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0821.5
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0812.2
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.080.1