List your company
ResearchFormerly WizWand

Language Understanding on MMLU (PRR)

89.3PRRTAD
0.27623.38846.569.612Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0889.3
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0888.5
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0888.3
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0888.3
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0887.3
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0884.4
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0865.4
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0855
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0841.8
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0841.2
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0840
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0832.1
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0828.8
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0827.4
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0824.3
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0823.7
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0823.6
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0823.5
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0822.5
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0820.3
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.0816.5
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=Acc.2024.083.7