List your company
ResearchFormerly WizWand

Machine Translation on MT (Mean PRR)

49.5Mean PRRRAUQ
18.40426.47734.5542.623May 26, 2025
Updated 4mo ago

Evaluation results

MethodLinks
RAUQLLM Backbone=Llama-3.2 1B2025.0549.5
RAUQLLM Backbone=SmolLM-2 360M2025.0549
PerplexityLLM Backbone=SmolLM-2 360M2025.0548.7
RAUQBase LLM=Gemma-2 9B2025.0547.3
RAUQBase LLM=Falcon-3 10B2025.0546.5
RAUQLLM Backbone=Llama-3.1 70B2025.0545.7
RAUQBase LLM=Llama-3.1 8B2025.0545.2
MSPLLM Backbone=Llama-3.1 70B2025.0544.7
PerplexityBase LLM=Falcon-3 10B2025.0543.9
RAUQBase LLM=Qwen-2.5 7B2025.0543.8
Simple FocusLLM Backbone=Llama-3.1 70B2025.0543.5
PerplexityLLM Backbone=Llama-3.2 1B2025.0542.7
Simple FocusLLM Backbone=Llama-3.2 1B2025.0542.4
Simple FocusBase LLM=Gemma-2 9B2025.0542.2
Simple FocusBase LLM=Llama-3.1 8B2025.0541.5
SARBase LLM=Gemma-2 9B2025.0541.4
Simple FocusLLM Backbone=SmolLM-2 360M2025.0541
SARLLM Backbone=Llama-3.2 1B2025.0540.8
PerplexityBase LLM=Qwen-2.5 7B2025.0540.6
PerplexityBase LLM=Gemma-2 9B2025.0540.5
Simple FocusBase LLM=Qwen-2.5 7B2025.0539.9
MSPBase LLM=Llama-3.1 8B2025.0539.7
SARBase LLM=Qwen-2.5 7B2025.0539.3
CCPLLM Backbone=Llama-3.1 70B2025.0538.7
FocusBase LLM=Gemma-2 9B2025.0538.5
Simple FocusBase LLM=Falcon-3 10B2025.0538.5
MSPBase LLM=Gemma-2 9B2025.0538.1
PerplexityBase LLM=Llama-3.1 8B2025.0538
FocusBase LLM=Qwen-2.5 7B2025.0538
Semantic EntropyLLM Backbone=Llama-3.1 70B2025.0537.3
SARLLM Backbone=Llama-3.1 70B2025.0537.2
SARBase LLM=Llama-3.1 8B2025.0537
MSPBase LLM=Qwen-2.5 7B2025.0536.9
FocusBase LLM=Falcon-3 10B2025.0536.2
FocusBase LLM=Llama-3.1 8B2025.0536.1
CCPLLM Backbone=SmolLM-2 360M2025.0536.1
MSPLLM Backbone=Llama-3.2 1B2025.0535.1
SARLLM Backbone=SmolLM-2 360M2025.0534.8
Lexical Similarity Rouge-LBase LLM=Gemma-2 9B2025.0534.2
CCPBase LLM=Llama-3.1 8B2025.0534
Semantic EntropyBase LLM=Gemma-2 9B2025.0533.7
SARBase LLM=Falcon-3 10B2025.0533.7
Lexical Similarity Rouge-LLLM Backbone=Llama-3.2 1B2025.0533.7
PerplexityLLM Backbone=Llama-3.1 70B2025.0533.5
MSPBase LLM=Falcon-3 10B2025.0533.3
Lexical Similarity Rouge-LLLM Backbone=Llama-3.1 70B2025.0533.2
MSPLLM Backbone=SmolLM-2 360M2025.0533
CCPLLM Backbone=Llama-3.2 1B2025.0532.8
CCPBase LLM=Qwen-2.5 7B2025.0532.7
Lexical Similarity Rouge-LBase LLM=Qwen-2.5 7B2025.0532.7
EigenScoreLLM Backbone=Llama-3.1 70B2025.0532.5
Lexical Similarity Rouge-LBase LLM=Llama-3.1 8B2025.0532.4
CCPBase LLM=Gemma-2 9B2025.0532
Semantic EntropyBase LLM=Qwen-2.5 7B2025.0531.7
Semantic EntropyBase LLM=Llama-3.1 8B2025.0531.5
Ecc. NLI Score entail.Base LLM=Qwen-2.5 7B2025.0530.6
EigenScoreBase LLM=Qwen-2.5 7B2025.0530.2
EigenScoreLLM Backbone=Llama-3.2 1B2025.0530.1
Ecc. NLI Score entail.LLM Backbone=Llama-3.1 70B2025.0529.8
Ecc. NLI Score entail.LLM Backbone=Llama-3.2 1B2025.0529.3
Semantic EntropyBase LLM=Falcon-3 10B2025.0529.1
Semantic DensityBase LLM=Qwen-2.5 7B2025.0529.1
Ecc. NLI Score entail.Base LLM=Gemma-2 9B2025.0529
CCPBase LLM=Falcon-3 10B2025.0528.7
DegMat NLI Score entail.LLM Backbone=Llama-3.2 1B2025.0528.7
EigenScoreBase LLM=Llama-3.1 8B2025.0528.5
Semantic DensityLLM Backbone=Llama-3.2 1B2025.0528.5
Ecc. NLI Score entail.Base LLM=Llama-3.1 8B2025.0528.4
Ecc. NLI Score entail.Base LLM=Falcon-3 10B2025.0528.1
Semantic DensityBase LLM=Falcon-3 10B2025.0528
DegMat NLI Score entail.Base LLM=Qwen-2.5 7B2025.0527.5
Lexical Similarity Rouge-LBase LLM=Falcon-3 10B2025.0527.5
DegMat NLI Score entail.LLM Backbone=Llama-3.1 70B2025.0527.3
EVL NLI Score entail.LLM Backbone=Llama-3.2 1B2025.0526.8
Semantic EntropyLLM Backbone=Llama-3.2 1B2025.0526.8
EVL NLI Score entail.LLM Backbone=Llama-3.1 70B2025.0526.5
Semantic DensityBase LLM=Llama-3.1 8B2025.0526.4
LUQLLM Backbone=Llama-3.2 1B2025.0526.3
DegMat NLI Score entail.Base LLM=Gemma-2 9B2025.0525.9
LUQBase LLM=Gemma-2 9B2025.0525.9
Semantic DensityLLM Backbone=SmolLM-2 360M2025.0525.9
Semantic DensityBase LLM=Gemma-2 9B2025.0525.5
LUQLLM Backbone=Llama-3.1 70B2025.0525.4
EVL NLI Score entail.Base LLM=Gemma-2 9B2025.0525.2
EVL NLI Score entail.Base LLM=Qwen-2.5 7B2025.0524.5
LUQLLM Backbone=SmolLM-2 360M2025.0524.2
DegMat NLI Score entail.Base LLM=Llama-3.1 8B2025.0523.9
Semantic DensityLLM Backbone=Llama-3.1 70B2025.0523.9
EigenScoreBase LLM=Falcon-3 10B2025.0523.6
DegMat NLI Score entail.LLM Backbone=SmolLM-2 360M2025.0522.7
Semantic EntropyLLM Backbone=SmolLM-2 360M2025.0522.7
EigenScoreBase LLM=Gemma-2 9B2025.0522.6
DegMat NLI Score entail.Base LLM=Falcon-3 10B2025.0522.2
EVL NLI Score entail.Base LLM=Llama-3.1 8B2025.0521.7
EVL NLI Score entail.LLM Backbone=SmolLM-2 360M2025.0521.6
LUQBase LLM=Llama-3.1 8B2025.0521.4
LUQBase LLM=Qwen-2.5 7B2025.0521.3
Attention ScoreLLM Backbone=Llama-3.1 70B2025.0521.3
EVL NLI Score entail.Base LLM=Falcon-3 10B2025.0520.6
LUQBase LLM=Falcon-3 10B2025.0519.6