List your company
ResearchFormerly WizWand

Machine Translation on WMT 19 (PRR)

66PRRLookBackLens
-0.45616.79734.0551.303Aug 20, 2024
Updated 6mo ago

Evaluation results

MethodLinks
LookBackLensBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0866
MINDBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0864.1
SheepsBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0864
SAPLMABackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0863.1
TADBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0862.3
LookBackLensBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0861.3
TADBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0859.2
TADBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0855.3
SAPLMABackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0854.8
LookBackLensBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0853.9
SATRMDBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0852.5
SATRMDBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0852.5
Simple FocusBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0852.1
SheepsBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0850.9
Simple FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0849.6
SheepsBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0848.7
MSPBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0848.4
Mean Token EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0847.5
SATRMDBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0847.5
Simple FocusBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0847.2
PerplexityBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0846.6
FocusBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0846.5
MSPBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0845.9
SARBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0845.5
Mean Token EntropyBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0845.3
FocusBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0845.2
MSPBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0845.1
MINDBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0845.1
PerplexityBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0844.9
SARBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0844.5
SARBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0843.5
Mean Token EntropyBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0842.5
PerplexityBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0841.6
FocusBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0841.6
Lexical Similarity Rouge-LBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0840.4
Lexical Similarity Rouge-LBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0840.3
Semantic EntropyBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0840.1
CCPBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0838.8
Semantic EntropyBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0837.9
EigenScoreBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0837.4
Lexical Similarity Rouge-LBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0837
CCPBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0836.9
Ecc. NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0836.8
Semantic EntropyBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0836.6
MINDBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0836.5
CCPBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0836.3
Semantic DensityBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0835.8
SAPLMABackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0834.5
Ecc. NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0834.3
Ecc. NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=Comet2024.0834
DegMat NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0833.2
EigenScoreBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0831.8
Semantic DensityBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0831.3
DegMat NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0831.2
EVL NLI Score entail.Backbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0830.2
Semantic DensityBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0829.5
EVL NLI Score entail.Backbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0829.4
DegMat NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=Comet2024.0828.5
LUQBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0827.6
LUQBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.0826.5
EVL NLI Score entail.Backbone=Llama-3.1 8b, Correctness Metric=Comet2024.0825.2
EigenScoreBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.0824.9
LUQBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0822.4
FactoscopeBackbone=Llama-3.1 8b, Correctness Metric=Comet2024.0812
FactoscopeBackbone=Qwen-2.5 7b, Reference Quality Metric=Comet2024.086.9
FactoscopeBackbone=Gemma-2 9b, Reference Quality Metric=Comet2024.082.1