List your company
ResearchFormerly WizWand

Question Answering on SciQ (PRR)

60PRRLookBackLens
-2.1732813.9678630.10946.25014Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0860
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0856.3
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0855.1
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0854.7
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0854
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0853.6
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0853.5
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0852.6
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0851.9
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0851.4
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0851
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0850.7
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0849.6
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0849.1
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0848.7
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0846.8
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0846.2
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0844.9
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0838.5
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0837.4
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0834.5
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0834.2
SATRMDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.595
TADBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.581
SATRMDBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.581
LookBackLensBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.574
SheepsBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.552
LookBackLensBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.542
Simple FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.523
MSPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.501
MINDBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.499
TADBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.488
Simple FocusBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.486
Semantic DensityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.463
MSPBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.459
SAPLMABackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.455
SheepsBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.455
MINDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.454
Semantic DensityBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.448
SARBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.439
FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.434
DegMat NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.429
DegMat NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.422
FocusBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.422
Ecc. NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.419
SAPLMABackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.399
Lexical Similarity Rouge-LBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.395
LUQBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.394
EVL NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.389
CCPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.385
Ecc. NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.38
Lexical Similarity Rouge-LBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.378
EVL NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.371
SARBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.362
EigenScoreBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.359
Semantic EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.355
EigenScoreBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.355
CCPBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.351
Semantic EntropyBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.347
LUQBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.342
FactoscopeBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.313
FactoscopeBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.306
PerplexityBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.244
PerplexityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.234
Mean Token EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.234
Mean Token EntropyBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.218