List your company
ResearchFormerly WizWand

Summarization on Summ

0.517Mean PRRCCP
0.013640.144320.2750.40568May 26, 2025
Updated 4mo ago

Evaluation results

MethodLinks
CCPLLM Backbone=Llama-3.2 1B2025.050.517
MSPLLM Backbone=Llama-3.2 1B2025.050.507
Simple FocusLLM Backbone=Llama-3.2 1B2025.050.488
CCPLLM Backbone=SmolLM-2 360M2025.050.457
MSPLLM Backbone=SmolLM-2 360M2025.050.449
Simple FocusLLM Backbone=SmolLM-2 360M2025.050.429
RAUQBase LLM=Llama-3.1 8B2025.050.428
RAUQLLM Backbone=Llama-3.2 1B2025.050.423
PerplexityBase LLM=Llama-3.1 8B2025.050.419
RAUQBase LLM=Gemma-2 9B2025.050.392
PerplexityLLM Backbone=Llama-3.2 1B2025.050.392
PerplexityBase LLM=Gemma-2 9B2025.050.375
RAUQLLM Backbone=SmolLM-2 360M2025.050.356
CCPBase LLM=Gemma-2 9B2025.050.345
FocusBase LLM=Gemma-2 9B2025.050.34
FocusBase LLM=Llama-3.1 8B2025.050.335
MSPBase LLM=Gemma-2 9B2025.050.334
PerplexityLLM Backbone=SmolLM-2 360M2025.050.33
Simple FocusBase LLM=Gemma-2 9B2025.050.322
CCPBase LLM=Llama-3.1 8B2025.050.307
Simple FocusBase LLM=Llama-3.1 8B2025.050.306
MSPBase LLM=Llama-3.1 8B2025.050.296
PerplexityBase LLM=Qwen-2.5 7B2025.050.254
PerplexityLLM Backbone=Llama-3.1 70B2025.050.245
RAUQLLM Backbone=Llama-3.1 70B2025.050.245
SARBase LLM=Gemma-2 9B2025.050.235
Semantic DensityLLM Backbone=Llama-3.2 1B2025.050.217
RAUQBase LLM=Qwen-2.5 7B2025.050.213
Semantic DensityLLM Backbone=SmolLM-2 360M2025.050.209
LUQBase LLM=Gemma-2 9B2025.050.206
LUQBase LLM=Qwen-2.5 7B2025.050.196
Attention ScoreBase LLM=Falcon-3 10B2025.050.192
CCPBase LLM=Qwen-2.5 7B2025.050.186
FocusBase LLM=Qwen-2.5 7B2025.050.186
RAUQBase LLM=Falcon-3 10B2025.050.181
PerplexityBase LLM=Falcon-3 10B2025.050.18
MSPBase LLM=Falcon-3 10B2025.050.177
LUQBase LLM=Llama-3.1 8B2025.050.173
SARBase LLM=Llama-3.1 8B2025.050.17
Semantic DensityBase LLM=Gemma-2 9B2025.050.167
Lexical Similarity Rouge-LBase LLM=Gemma-2 9B2025.050.161
DegMat NLI Score entail.Base LLM=Qwen-2.5 7B2025.050.154
EVL NLI Score entail.Base LLM=Qwen-2.5 7B2025.050.154
SARBase LLM=Qwen-2.5 7B2025.050.153
Semantic DensityBase LLM=Llama-3.1 8B2025.050.153
MSPBase LLM=Qwen-2.5 7B2025.050.151
Semantic DensityBase LLM=Falcon-3 10B2025.050.141
FocusBase LLM=Falcon-3 10B2025.050.139
LUQLLM Backbone=Llama-3.1 70B2025.050.139
DegMat NLI Score entail.Base LLM=Gemma-2 9B2025.050.138
Simple FocusBase LLM=Qwen-2.5 7B2025.050.136
EVL NLI Score entail.Base LLM=Falcon-3 10B2025.050.135
CCPLLM Backbone=Llama-3.1 70B2025.050.135
EVL NLI Score entail.Base LLM=Gemma-2 9B2025.050.133
Semantic EntropyBase LLM=Falcon-3 10B2025.050.133
DegMat NLI Score entail.Base LLM=Falcon-3 10B2025.050.132
Lexical Similarity Rouge-LBase LLM=Llama-3.1 8B2025.050.131
Lexical Similarity Rouge-LBase LLM=Qwen-2.5 7B2025.050.131
Attention ScoreBase LLM=Qwen-2.5 7B2025.050.13
CCPBase LLM=Falcon-3 10B2025.050.128
MSPLLM Backbone=Llama-3.1 70B2025.050.128
Simple FocusLLM Backbone=Llama-3.1 70B2025.050.128
Attention ScoreBase LLM=Llama-3.1 8B2025.050.126
Semantic EntropyBase LLM=Gemma-2 9B2025.050.126
LUQBase LLM=Falcon-3 10B2025.050.121
DegMat NLI Score entail.Base LLM=Llama-3.1 8B2025.050.118
LUQLLM Backbone=Llama-3.2 1B2025.050.118
Semantic EntropyBase LLM=Llama-3.1 8B2025.050.117
EVL NLI Score entail.Base LLM=Llama-3.1 8B2025.050.114
Semantic DensityBase LLM=Qwen-2.5 7B2025.050.11
EigenScoreBase LLM=Gemma-2 9B2025.050.106
SARLLM Backbone=Llama-3.1 70B2025.050.106
Attention ScoreBase LLM=Gemma-2 9B2025.050.103
Semantic DensityLLM Backbone=Llama-3.1 70B2025.050.1
Simple FocusBase LLM=Falcon-3 10B2025.050.095
SARLLM Backbone=SmolLM-2 360M2025.050.095
SARBase LLM=Falcon-3 10B2025.050.094
Semantic EntropyBase LLM=Qwen-2.5 7B2025.050.092
SARLLM Backbone=Llama-3.2 1B2025.050.091
DegMat NLI Score entail.LLM Backbone=Llama-3.1 70B2025.050.091
EVL NLI Score entail.LLM Backbone=Llama-3.1 70B2025.050.091
Lexical Similarity Rouge-LLLM Backbone=Llama-3.1 70B2025.050.089
Lexical Similarity Rouge-LBase LLM=Falcon-3 10B2025.050.084
Semantic EntropyLLM Backbone=Llama-3.2 1B2025.050.084
EigenScoreBase LLM=Llama-3.1 8B2025.050.078
DegMat NLI Score entail.LLM Backbone=Llama-3.2 1B2025.050.078
LUQLLM Backbone=SmolLM-2 360M2025.050.076
Lexical Similarity Rouge-LLLM Backbone=Llama-3.2 1B2025.050.074
EVL NLI Score entail.LLM Backbone=Llama-3.2 1B2025.050.072
Semantic EntropyLLM Backbone=Llama-3.1 70B2025.050.069
EigenScoreLLM Backbone=SmolLM-2 360M2025.050.068
Semantic EntropyLLM Backbone=SmolLM-2 360M2025.050.067
EigenScoreBase LLM=Qwen-2.5 7B2025.050.061
DegMat NLI Score entail.LLM Backbone=SmolLM-2 360M2025.050.059
EVL NLI Score entail.LLM Backbone=SmolLM-2 360M2025.050.055
EigenScoreBase LLM=Falcon-3 10B2025.050.051
Attention ScoreLLM Backbone=Llama-3.1 70B2025.050.045
EigenScoreLLM Backbone=Llama-3.1 70B2025.050.044
Ecc. NLI Score entail.Base LLM=Falcon-3 10B2025.050.038
Attention ScoreLLM Backbone=Llama-3.2 1B2025.050.033