List your company
ResearchFormerly WizWand

Summarization on CNN/DM (MAT, Speedup)

6.51MAT ScoreGraft
0.77962.26733.7555.2427Jul 2, 2025Aug 24, 2025Oct 17, 2025Dec 9, 2025Feb 1, 2026Mar 26, 2026May 19, 2026
Updated 5mo ago

Evaluation results

MethodLinks
GraftModel=Vicuna-13B2026.056.513.63
EAGLE3-2KModel=Vicuna-13B2026.056.423.42
ECHOModel=Vicuna-13B2026.056.223.49
DDDModel=Vicuna-13B2026.056.073.48
GraftModel=LLaMA3.1-8B2026.055.653.31
EAGLE3-2KModel=LLaMA3.1-8B2026.055.473.05
ECHOModel=LLaMA3.1-8B2026.055.243.18
GraftModel=Qwen3-8B2026.053.412.37
EAGLE3Model=Qwen3-8B2026.053.251.95
ECHOModel=Qwen3-8B2026.053.182.23
TRModel=Vicuna-13B2026.052.882.24
GraftModel=Qwen3-32B2026.052.792.19
SAMDModel=Vicuna-13B2026.052.712.05
TRModel=Qwen3-8B2026.052.672.13
TRModel=LLaMA3.1-8B2026.052.652.14
EAGLE3Model=Qwen3-32B2026.052.551.82
TRModel=Qwen3-32B2026.052.531.97
ECHOModel=Qwen3-32B2026.052.511.98
PLDModel=Vicuna-13B2026.052.312.45
SpsModel=Vicuna-13B2026.052.261.69
TRModel=Qwen3-235B2026.052.231.77
GraftModel=Qwen3-235B2026.052.211.83
MedusaModel=Vicuna-13B2026.052.051.63
LogitSpecModel=Llama-3.1-8B-Instruct2025.072.041.85
EAGLE3-2KModel=Qwen3-235B2026.052.021.45
ECHOModel=Qwen3-235B2026.052.011.64
LogitSpecModel=Qwen-3-8B2025.071.771.59
LookaheadModel=Vicuna-13B2026.051.511.46
VanillaModel=Llama-3.1-8B-Instruct2025.0711
VanillaModel=Qwen-3-8B2025.0711