List your company
ResearchFormerly WizWand

Question Answering on CoQA (PRR)

0.423PRRSheeps
-0.032520.085740.2040.32226Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
SheepsBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.423
Semantic DensityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.401
TADBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.395
TADBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.392
Semantic DensityBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.38
SATRMDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.359
LookBackLensBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.341
Simple FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.335
SATRMDBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.333
SARBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.323
Lexical Similarity Rouge-LBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.319
LookBackLensBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.317
DegMat NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.316
PerplexityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.314
EVL NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.314
DegMat NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.312
MSPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.31
Mean Token EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.304
EVL NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.304
LUQBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.303
LUQBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.301
Ecc. NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.299
SARBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.297
Ecc. NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.293
FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.289
Simple FocusBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.281
CCPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.277
Lexical Similarity Rouge-LBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.277
EigenScoreBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.27
SheepsBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.27
Semantic EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.265
EigenScoreBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.263
MINDBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.263
MSPBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.262
PerplexityBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.259
MINDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.252
Mean Token EntropyBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.251
Semantic EntropyBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.232
FocusBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.211
CCPBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.21
FactoscopeBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.033
SAPLMABackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.08-0.002
FactoscopeBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.08-0.013
SAPLMABackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.08-0.015