List your company
ResearchFormerly WizWand

Selective Generation on SciQ

86.1ROC-AUCSATRMD
64.98870.46975.9581.431Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
SATRMDBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0886.1
LookBackLensBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0885.2
SATRMDBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0884.5
LookBackLensBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0884.3
TADBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0883.1
SheepsBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0882.7
LookBackLensBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0882.6
TADBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0882
TADBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0882
MINDBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0881.3
SARBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0880.8
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0880.7
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0880.6
Simple FocusBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0880.6
Simple FocusBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0880.4
EVL NLI Score entail.Backbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0880.2
Simple FocusBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.8
Semantic DensityBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.8
MSPBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.7
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.7
SATRMDBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.7
SARBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0879.6
EigenScoreBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.5
MINDBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.5
Semantic EntropyBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0879.1
MSPBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0878.6
FocusBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0878.5
Semantic DensityBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0878.5
DegMat NLI Score entail.Base Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0877.8
LUQBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0877.6
SheepsBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0877.6
MSPBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0877.6
FocusBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0877.4
LUQBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0877.4
Semantic DensityBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0877.2
SAPLMABackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0877.2
DegMat NLI Score entail.Backbone=Gemma-2 9b, Reference Metric=AlignScore2024.0877.1
SARBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0877.1
MINDBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0876.6
SheepsBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0876.4
Lexical Similarity Rouge-LBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0876.3
EVL NLI Score entail.Backbone=Gemma-2 9b, Reference Metric=AlignScore2024.0875.6
Ecc. NLI Score entail.Backbone=Gemma-2 9b, Reference Metric=AlignScore2024.0875.5
LUQBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0875.5
Lexical Similarity Rouge-LBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0875.5
CCPBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0875.1
FocusBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0874.6
EVL NLI Score entail.Base Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0874.4
SAPLMABase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0874.1
Ecc. NLI Score entail.Base Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0874
Semantic EntropyBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0873.6
PerplexityBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0873.5
EigenScoreBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0872.9
Semantic EntropyBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0872.4
SAPLMABackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0872
FactoscopeBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0871.5
Mean Token EntropyBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0871.1
CCPBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0871.1
EigenScoreBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0871
FactoscopeBackbone=Qwen-2.5 7b, UQ Level=Sequence-level, Reference Metric=AlignScore2024.0870.6
CCPBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0870.4
FactoscopeBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0869.8
PerplexityBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0867.8
Mean Token EntropyBase Model=Llama-3.1 8b, Ground Truth Metric=AlignScore2024.0866.9
PerplexityBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0866.4
Mean Token EntropyBackbone=Gemma-2 9b, Reference Metric=AlignScore2024.0865.8