List your company
ResearchFormerly WizWand

Question Answering on MedQUAD

58.3PRRTAD
-2.368413.3820529.132544.88295Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0858.3
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0851.7
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0849.7
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0844.7
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0839.1
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0836.2
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0814.3
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0813.1
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0812.3
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0812.2
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0812.2
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.0810.7
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.089.6
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.089.5
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.088.8
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.087.5
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.087.3
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.083
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.082.1
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.081.8
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.081.8
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=AlignScore2024.081.5
LookBackLensBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.705
MINDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.671
SAPLMABackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.667
TADBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.624
SATRMDBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.612
TADBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.59
LookBackLensBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.547
MINDBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.531
FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.514
FactoscopeBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.511
SheepsBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.501
FactoscopeBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.471
SheepsBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.436
SATRMDBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.424
Mean Token EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.422
PerplexityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.397
Semantic DensityBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.272
PerplexityBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.249
Mean Token EntropyBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.238
SAPLMABackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.228
LUQBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.222
SARBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.203
EVL NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.176
Semantic DensityBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.175
Simple FocusBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.17
DegMat NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.167
DegMat NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.146
FocusBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.137
EVL NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.137
SARBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.107
Ecc. NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.102
LUQBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.101
Semantic EntropyBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.093
MSPBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.091
Semantic EntropyBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.083
Simple FocusBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.074
CCPBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.080.038
Ecc. NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.037
CCPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.028
MSPBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.080.004
EigenScoreBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.08-0.01
Lexical Similarity Rouge-LBackbone=Llama-3.1 8b, Correctness Metric=AlignScore2024.08-0.017
EigenScoreBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.08-0.024
Lexical Similarity Rouge-LBackbone=Gemma-2 9b, Reference Quality Metric=AlignScore2024.08-0.035