List your company
ResearchFormerly WizWand

Summarization on MultiNews (F1)

34.79F1 ScoreOriginal Prompt
19.907623.771327.63531.4987Feb 2, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Original PromptBackbone=LLaMA-3.1-8B-Instruct2026.0234.79
Original PromptBackbone=Qwen3-4B-Instruct2026.0232.09
RAMBackbone=Qwen3-4B-Instruct, Compression=4x2026.0232.07
EXITBackbone=Qwen3-4B-Instruct, Compression=4x2026.0231.86
ProvenceBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0230.14
LLMLingua-2-largeBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0230.08
EXITBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0229.71
LLMLingua-2-largeBackbone=Qwen3-4B-Instruct, Compression=4x2026.0229.56
RAMBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0229.21
Activation BeaconBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0228.52
RAMBackbone=Qwen3-4B-Instruct, Compression=8x2026.0228.5
ProvenceBackbone=Qwen3-4B-Instruct, Compression=4x2026.0228.3
ICAEBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0228.16
EXITBackbone=Qwen3-4B-Instruct, Compression=8x2026.0228.07
ICAEBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0227.92
LLMLingua-2-largeBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0227.55
EXITBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0227.15
LLMLingua-2-largeBackbone=Qwen3-4B-Instruct, Compression=8x2026.0226.41
LongLLMLinguaBackbone=LLaMA-3.1-8B-Instruct, Compression=4x2026.0226.32
ProvenceBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0226.19
RAMBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0226.11
Activation BeaconBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0225.19
ProvenceBackbone=Qwen3-4B-Instruct, Compression=8x2026.0224.47
LongLLMLinguaBackbone=Qwen3-4B-Instruct, Compression=4x2026.0224.15
ICAEBackbone=Qwen3-4B-Instruct, Compression=8x2026.0223.42
ICAEBackbone=Qwen3-4B-Instruct, Compression=4x2026.0222.78
LongLLMLinguaBackbone=LLaMA-3.1-8B-Instruct, Compression=8x2026.0221.56
LongLLMLinguaBackbone=Qwen3-4B-Instruct, Compression=8x2026.0220.48