List your company
ResearchFormerly WizWand

Question Answering on QA (Mean PRR)

42.5Mean PRRRAUQ
17.74824.17430.637.026May 26, 2025
Updated 4mo ago

Evaluation results

MethodLinks
RAUQLLM Backbone=SmolLM-2 360M2025.0542.5
RAUQBase LLM=Gemma-2 9B2025.0542.1
FocusBase LLM=Gemma-2 9B2025.0541.6
Simple FocusLLM Backbone=SmolLM-2 360M2025.0540.1
Simple FocusBase LLM=Gemma-2 9B2025.0539.6
RAUQBase LLM=Llama-3.1 8B2025.0539.6
RAUQBase LLM=Falcon-3 10B2025.0539.2
Semantic DensityLLM Backbone=Llama-3.1 70B2025.0538.5
PerplexityBase LLM=Gemma-2 9B2025.0538.3
SARLLM Backbone=Llama-3.1 70B2025.0538.2
Simple FocusLLM Backbone=Llama-3.1 70B2025.0538
DegMat NLI Score entail.LLM Backbone=Llama-3.1 70B2025.0538
LUQLLM Backbone=Llama-3.1 70B2025.0537.6
Semantic DensityBase LLM=Gemma-2 9B2025.0537.5
PerplexityLLM Backbone=SmolLM-2 360M2025.0537.1
Simple FocusLLM Backbone=Llama-3.2 1B2025.0537
EVL NLI Score entail.LLM Backbone=Llama-3.1 70B2025.0536.9
MSPLLM Backbone=Llama-3.1 70B2025.0536.4
Lexical Similarity Rouge-LLLM Backbone=Llama-3.1 70B2025.0536.2
MSPBase LLM=Gemma-2 9B2025.0536.1
SARBase LLM=Gemma-2 9B2025.0536.1
MSPLLM Backbone=SmolLM-2 360M2025.0536
RAUQLLM Backbone=Llama-3.1 70B2025.0536
Semantic DensityBase LLM=Falcon-3 10B2025.0535.8
RAUQBase LLM=Qwen-2.5 7B2025.0535.8
Semantic DensityLLM Backbone=SmolLM-2 360M2025.0535.7
PerplexityBase LLM=Falcon-3 10B2025.0535.6
DegMat NLI Score entail.Base LLM=Qwen-2.5 7B2025.0535.6
RAUQLLM Backbone=Llama-3.2 1B2025.0535.6
DegMat NLI Score entail.Base LLM=Falcon-3 10B2025.0535.2
Semantic DensityBase LLM=Qwen-2.5 7B2025.0535.2
Simple FocusBase LLM=Falcon-3 10B2025.0535.1
EVL NLI Score entail.Base LLM=Falcon-3 10B2025.0535.1
LUQBase LLM=Qwen-2.5 7B2025.0535.1
SARBase LLM=Qwen-2.5 7B2025.0535.1
CCPLLM Backbone=Llama-3.1 70B2025.0535
EVL NLI Score entail.Base LLM=Qwen-2.5 7B2025.0534.9
Semantic DensityLLM Backbone=Llama-3.2 1B2025.0534.8
MSPBase LLM=Llama-3.1 8B2025.0534.7
PerplexityBase LLM=Llama-3.1 8B2025.0534.7
MSPBase LLM=Falcon-3 10B2025.0534.5
LUQBase LLM=Gemma-2 9B2025.0534.4
PerplexityBase LLM=Qwen-2.5 7B2025.0534.3
SARLLM Backbone=SmolLM-2 360M2025.0534.3
Simple FocusBase LLM=Llama-3.1 8B2025.0534.2
Simple FocusBase LLM=Qwen-2.5 7B2025.0534.2
DegMat NLI Score entail.LLM Backbone=SmolLM-2 360M2025.0534.2
DegMat NLI Score entail.Base LLM=Gemma-2 9B2025.0533.7
LUQLLM Backbone=SmolLM-2 360M2025.0533.7
LUQBase LLM=Falcon-3 10B2025.0533.5
Lexical Similarity Rouge-LBase LLM=Qwen-2.5 7B2025.0533.4
SARBase LLM=Falcon-3 10B2025.0533.4
EVL NLI Score entail.LLM Backbone=SmolLM-2 360M2025.0533.3
EVL NLI Score entail.Base LLM=Gemma-2 9B2025.0533.2
Semantic DensityBase LLM=Llama-3.1 8B2025.0533
Ecc. NLI Score entail.LLM Backbone=Llama-3.1 70B2025.0533
MSPBase LLM=Qwen-2.5 7B2025.0532.9
CCPBase LLM=Gemma-2 9B2025.0532.9
Ecc. NLI Score entail.Base LLM=Falcon-3 10B2025.0532.7
MSPLLM Backbone=Llama-3.2 1B2025.0532.4
PerplexityLLM Backbone=Llama-3.1 70B2025.0532.3
Ecc. NLI Score entail.Base LLM=Qwen-2.5 7B2025.0532.2
FocusBase LLM=Llama-3.1 8B2025.0532
Semantic EntropyBase LLM=Falcon-3 10B2025.0532
FocusBase LLM=Falcon-3 10B2025.0531.3
SARBase LLM=Llama-3.1 8B2025.0531
PerplexityLLM Backbone=Llama-3.2 1B2025.0531
Semantic EntropyLLM Backbone=Llama-3.1 70B2025.0530.9
DegMat NLI Score entail.Base LLM=Llama-3.1 8B2025.0530.6
Lexical Similarity Rouge-LBase LLM=Gemma-2 9B2025.0530.6
DegMat NLI Score entail.LLM Backbone=Llama-3.2 1B2025.0530.5
CCPBase LLM=Falcon-3 10B2025.0529.9
Ecc. NLI Score entail.Base LLM=Gemma-2 9B2025.0529.8
EigenScoreBase LLM=Qwen-2.5 7B2025.0529.8
EVL NLI Score entail.LLM Backbone=Llama-3.2 1B2025.0529.8
EigenScoreLLM Backbone=Llama-3.1 70B2025.0529.6
SARLLM Backbone=Llama-3.2 1B2025.0529.5
EVL NLI Score entail.Base LLM=Llama-3.1 8B2025.0529.3
Semantic EntropyBase LLM=Gemma-2 9B2025.0529.1
Lexical Similarity Rouge-LLLM Backbone=SmolLM-2 360M2025.0529
LUQBase LLM=Llama-3.1 8B2025.0528.7
CCPBase LLM=Llama-3.1 8B2025.0528.5
Lexical Similarity Rouge-LBase LLM=Falcon-3 10B2025.0528.5
CCPLLM Backbone=Llama-3.2 1B2025.0528.3
Semantic EntropyBase LLM=Qwen-2.5 7B2025.0528.1
CCPLLM Backbone=SmolLM-2 360M2025.0528.1
LUQLLM Backbone=Llama-3.2 1B2025.0527.9
Ecc. NLI Score entail.Base LLM=Llama-3.1 8B2025.0527.4
CCPBase LLM=Qwen-2.5 7B2025.0527.1
EigenScoreBase LLM=Gemma-2 9B2025.0526.7
FocusBase LLM=Qwen-2.5 7B2025.0526.4
Lexical Similarity Rouge-LLLM Backbone=Llama-3.2 1B2025.0525.5
Semantic EntropyBase LLM=Llama-3.1 8B2025.0525.4
Lexical Similarity Rouge-LBase LLM=Llama-3.1 8B2025.0525
EigenScoreBase LLM=Falcon-3 10B2025.0524.7
EigenScoreBase LLM=Llama-3.1 8B2025.0523.2
Ecc. NLI Score entail.LLM Backbone=Llama-3.2 1B2025.0522.5
Ecc. NLI Score entail.LLM Backbone=SmolLM-2 360M2025.0520.9
Semantic EntropyLLM Backbone=SmolLM-2 360M2025.0520.1
Semantic EntropyLLM Backbone=Llama-3.2 1B2025.0518.7