Machine Translation on MT (Mean PRR)
49.5Mean PRRRAUQ
Evaluation Results
| Method | Links | |
|---|---|---|
| RAUQLLM Backbone=Llama-3.2 1B2025.05 | 49.5 | |
| RAUQLLM Backbone=SmolLM-2 360M2025.05 | 49 | |
| PerplexityLLM Backbone=SmolLM-2 360M2025.05 | 48.7 | |
| RAUQBase LLM=Gemma-2 9B2025.05 | 47.3 | |
| RAUQBase LLM=Falcon-3 10B2025.05 | 46.5 | |
| RAUQLLM Backbone=Llama-3.1 70B2025.05 | 45.7 | |
| RAUQBase LLM=Llama-3.1 8B2025.05 | 45.2 | |
| MSPLLM Backbone=Llama-3.1 70B2025.05 | 44.7 | |
| PerplexityBase LLM=Falcon-3 10B2025.05 | 43.9 | |
| RAUQBase LLM=Qwen-2.5 7B2025.05 | 43.8 | |
| Simple FocusLLM Backbone=Llama-3.1 70B2025.05 | 43.5 | |
| PerplexityLLM Backbone=Llama-3.2 1B2025.05 | 42.7 | |
| Simple FocusLLM Backbone=Llama-3.2 1B2025.05 | 42.4 | |
| Simple FocusBase LLM=Gemma-2 9B2025.05 | 42.2 | |
| Simple FocusBase LLM=Llama-3.1 8B2025.05 | 41.5 | |
| SARBase LLM=Gemma-2 9B2025.05 | 41.4 | |
| Simple FocusLLM Backbone=SmolLM-2 360M2025.05 | 41 | |
| SARLLM Backbone=Llama-3.2 1B2025.05 | 40.8 | |
| PerplexityBase LLM=Qwen-2.5 7B2025.05 | 40.6 | |
| PerplexityBase LLM=Gemma-2 9B2025.05 | 40.5 | |
| Simple FocusBase LLM=Qwen-2.5 7B2025.05 | 39.9 | |
| MSPBase LLM=Llama-3.1 8B2025.05 | 39.7 | |
| SARBase LLM=Qwen-2.5 7B2025.05 | 39.3 | |
| CCPLLM Backbone=Llama-3.1 70B2025.05 | 38.7 | |
| FocusBase LLM=Gemma-2 9B2025.05 | 38.5 | |
| Simple FocusBase LLM=Falcon-3 10B2025.05 | 38.5 | |
| MSPBase LLM=Gemma-2 9B2025.05 | 38.1 | |
| PerplexityBase LLM=Llama-3.1 8B2025.05 | 38 | |
| FocusBase LLM=Qwen-2.5 7B2025.05 | 38 | |
| Semantic EntropyLLM Backbone=Llama-3.1 70B2025.05 | 37.3 | |
| SARLLM Backbone=Llama-3.1 70B2025.05 | 37.2 | |
| SARBase LLM=Llama-3.1 8B2025.05 | 37 | |
| MSPBase LLM=Qwen-2.5 7B2025.05 | 36.9 | |
| FocusBase LLM=Falcon-3 10B2025.05 | 36.2 | |
| FocusBase LLM=Llama-3.1 8B2025.05 | 36.1 | |
| CCPLLM Backbone=SmolLM-2 360M2025.05 | 36.1 | |
| MSPLLM Backbone=Llama-3.2 1B2025.05 | 35.1 | |
| SARLLM Backbone=SmolLM-2 360M2025.05 | 34.8 | |
| Lexical Similarity Rouge-LBase LLM=Gemma-2 9B2025.05 | 34.2 | |
| CCPBase LLM=Llama-3.1 8B2025.05 | 34 | |
| Semantic EntropyBase LLM=Gemma-2 9B2025.05 | 33.7 | |
| SARBase LLM=Falcon-3 10B2025.05 | 33.7 | |
| Lexical Similarity Rouge-LLLM Backbone=Llama-3.2 1B2025.05 | 33.7 | |
| PerplexityLLM Backbone=Llama-3.1 70B2025.05 | 33.5 | |
| MSPBase LLM=Falcon-3 10B2025.05 | 33.3 | |
| Lexical Similarity Rouge-LLLM Backbone=Llama-3.1 70B2025.05 | 33.2 | |
| MSPLLM Backbone=SmolLM-2 360M2025.05 | 33 | |
| CCPLLM Backbone=Llama-3.2 1B2025.05 | 32.8 | |
| CCPBase LLM=Qwen-2.5 7B2025.05 | 32.7 | |
| Lexical Similarity Rouge-LBase LLM=Qwen-2.5 7B2025.05 | 32.7 | |
| EigenScoreLLM Backbone=Llama-3.1 70B2025.05 | 32.5 | |
| Lexical Similarity Rouge-LBase LLM=Llama-3.1 8B2025.05 | 32.4 | |
| CCPBase LLM=Gemma-2 9B2025.05 | 32 | |
| Semantic EntropyBase LLM=Qwen-2.5 7B2025.05 | 31.7 | |
| Semantic EntropyBase LLM=Llama-3.1 8B2025.05 | 31.5 | |
| Ecc. NLI Score entail.Base LLM=Qwen-2.5 7B2025.05 | 30.6 | |
| EigenScoreBase LLM=Qwen-2.5 7B2025.05 | 30.2 | |
| EigenScoreLLM Backbone=Llama-3.2 1B2025.05 | 30.1 | |
| Ecc. NLI Score entail.LLM Backbone=Llama-3.1 70B2025.05 | 29.8 | |
| Ecc. NLI Score entail.LLM Backbone=Llama-3.2 1B2025.05 | 29.3 | |
| Semantic EntropyBase LLM=Falcon-3 10B2025.05 | 29.1 | |
| Semantic DensityBase LLM=Qwen-2.5 7B2025.05 | 29.1 | |
| Ecc. NLI Score entail.Base LLM=Gemma-2 9B2025.05 | 29 | |
| CCPBase LLM=Falcon-3 10B2025.05 | 28.7 | |
| DegMat NLI Score entail.LLM Backbone=Llama-3.2 1B2025.05 | 28.7 | |
| EigenScoreBase LLM=Llama-3.1 8B2025.05 | 28.5 | |
| Semantic DensityLLM Backbone=Llama-3.2 1B2025.05 | 28.5 | |
| Ecc. NLI Score entail.Base LLM=Llama-3.1 8B2025.05 | 28.4 | |
| Ecc. NLI Score entail.Base LLM=Falcon-3 10B2025.05 | 28.1 | |
| Semantic DensityBase LLM=Falcon-3 10B2025.05 | 28 | |
| DegMat NLI Score entail.Base LLM=Qwen-2.5 7B2025.05 | 27.5 | |
| Lexical Similarity Rouge-LBase LLM=Falcon-3 10B2025.05 | 27.5 | |
| DegMat NLI Score entail.LLM Backbone=Llama-3.1 70B2025.05 | 27.3 | |
| EVL NLI Score entail.LLM Backbone=Llama-3.2 1B2025.05 | 26.8 | |
| Semantic EntropyLLM Backbone=Llama-3.2 1B2025.05 | 26.8 | |
| EVL NLI Score entail.LLM Backbone=Llama-3.1 70B2025.05 | 26.5 | |
| Semantic DensityBase LLM=Llama-3.1 8B2025.05 | 26.4 | |
| LUQLLM Backbone=Llama-3.2 1B2025.05 | 26.3 | |
| DegMat NLI Score entail.Base LLM=Gemma-2 9B2025.05 | 25.9 | |
| LUQBase LLM=Gemma-2 9B2025.05 | 25.9 | |
| Semantic DensityLLM Backbone=SmolLM-2 360M2025.05 | 25.9 | |
| Semantic DensityBase LLM=Gemma-2 9B2025.05 | 25.5 | |
| LUQLLM Backbone=Llama-3.1 70B2025.05 | 25.4 | |
| EVL NLI Score entail.Base LLM=Gemma-2 9B2025.05 | 25.2 | |
| EVL NLI Score entail.Base LLM=Qwen-2.5 7B2025.05 | 24.5 | |
| LUQLLM Backbone=SmolLM-2 360M2025.05 | 24.2 | |
| DegMat NLI Score entail.Base LLM=Llama-3.1 8B2025.05 | 23.9 | |
| Semantic DensityLLM Backbone=Llama-3.1 70B2025.05 | 23.9 | |
| EigenScoreBase LLM=Falcon-3 10B2025.05 | 23.6 | |
| DegMat NLI Score entail.LLM Backbone=SmolLM-2 360M2025.05 | 22.7 | |
| Semantic EntropyLLM Backbone=SmolLM-2 360M2025.05 | 22.7 | |
| EigenScoreBase LLM=Gemma-2 9B2025.05 | 22.6 | |
| DegMat NLI Score entail.Base LLM=Falcon-3 10B2025.05 | 22.2 | |
| EVL NLI Score entail.Base LLM=Llama-3.1 8B2025.05 | 21.7 | |
| EVL NLI Score entail.LLM Backbone=SmolLM-2 360M2025.05 | 21.6 | |
| LUQBase LLM=Llama-3.1 8B2025.05 | 21.4 | |
| LUQBase LLM=Qwen-2.5 7B2025.05 | 21.3 | |
| Attention ScoreLLM Backbone=Llama-3.1 70B2025.05 | 21.3 | |
| EVL NLI Score entail.Base LLM=Falcon-3 10B2025.05 | 20.6 | |
| LUQBase LLM=Falcon-3 10B2025.05 | 19.6 |