List your company
ResearchFormerly WizWand

Summarization on SAMSum (ROUGE)

27.2ROUGE ScoreVanilla
13.05616.72820.424.072May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
VanillaBackbone=Vicuna-7B-v1.52026.0527.2
LoRABackbone=Vicuna-7B-v1.52026.0526.8
LEDBackbone=Vicuna-7B-v1.52026.0526.7
VanillaBackbone=Llama2-7B-chat2026.0526.7
Circuit BreakersBackbone=Vicuna-7B-v1.52026.0526.2
EVA (text)Backbone=Vicuna-7B-v1.52026.0526
Circuit BreakersBackbone=Llama2-7B-chat2026.0526
LoRABackbone=Llama2-7B-chat2026.0525.9
LoRABackbone=Mistral-7B-Instruct-v0.22026.0525.8
LoRABackbone=Qwen2.5-7B-Instruct2026.0525.8
LEDBackbone=Llama2-7B-chat2026.0525.6
EVA (text)Backbone=Llama3.1-8B-Instruct2026.0525.6
EVA (text)Backbone=Qwen2.5-7B-Instruct2026.0525.6
VanillaBackbone=Mistral-7B-Instruct-v0.22026.0525.5
Circuit BreakersBackbone=Mistral-7B-Instruct-v0.22026.0525.4
VanillaBackbone=Llama3.1-8B-Instruct2026.0525.4
LoRABackbone=Llama3.1-8B-Instruct2026.0525.4
VanillaBackbone=Qwen2.5-7B-Instruct2026.0525.4
LEDBackbone=Qwen2.5-7B-Instruct2026.0525.4
Circuit BreakersBackbone=Qwen2.5-7B-Instruct2026.0525.4
Circuit BreakersBackbone=Llama3.1-8B-Instruct2026.0525.2
EVA (text)Backbone=Llama2-7B-chat2026.0525.1
LEDBackbone=Llama3.1-8B-Instruct2026.0525.1
SafeDecodingBackbone=Qwen2.5-7B-Instruct2026.0523.9
SafeDecodingBackbone=Llama2-7B-chat2026.0522.7
LEDBackbone=Mistral-7B-Instruct-v0.22026.0522.1
EVA (text)Backbone=Mistral-7B-Instruct-v0.22026.0520.5
SafeDecodingBackbone=Mistral-7B-Instruct-v0.22026.0520.4
SafeDecodingBackbone=Vicuna-7B-v1.52026.0517.4
SafeDecodingBackbone=Llama3.1-8B-Instruct2026.0513.6