List your company
ResearchFormerly WizWand

Summarization on BillSum

69.6AccuracyDense Model
61.863.82565.8567.875Jan 27, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Dense ModelBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=0%2026.0169.6
FT(Llama3.2)Base Model=Llama3.2-3B, Fine-tuning Protocol=FFT, Sparsity=0%2026.0168.8
GradPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0168.7
Dense ModelBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=0%2026.0168.4
Dense ModelBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=0%2026.0168.1
Dense ModelBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=0%2026.0167.7
GradPrunerBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0167
FT(Llama3.2)Base Model=Llama3.2-3B, Fine-tuning Protocol=LoRA, Sparsity=0%2026.0166.2
GradPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0165.9
GradPrunerBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0165.9
SATBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0165.7
SATBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0165.6
MINITRONBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0165
LacoBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0164.9
APTBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0164.5
LacoBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0164.3
LLMPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0164.1
LacoBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0164.1
MINITRONBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0164
LLMPrunerBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.0163.9
LLMPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0163.6
MINITRONBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0163.3
LacoBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0163.1
MINITRONBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0163.1
APTBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0163.1
SATBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0162.9
LLMPrunerBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0162.5
SATBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.0162.1