List your company
ResearchFormerly WizWand

Reading Comprehension on Race M (Score)

45.47Race M ScoreRWKV-7B
20.343626.866833.3939.9132Mar 6, 2024May 15, 2024Jul 25, 2024Oct 4, 2024Dec 14, 2024Feb 23, 2025May 5, 2025
Updated 8mo ago

Evaluation results

MethodLinks
RWKV-7BBackbone=RWKV-7B, Pruning ratio=0%2024.0345.47
ReplaceMe (LS)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.0537.1
ReplaceMe (Cosine)Train-Free=true, Base Model=Llama 2 7B, Compression Ratio=25%2025.0535.4
UIDLTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.0535.2
LLM-StreamlineTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.0534.8
Llama 2 7B (baseline)Base Model=Llama 2 7B, Compression Ratio=0%2025.0533.1
SliceGPTTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.0527
ShortGPTBackbone=RWKV-7B, Pruning ratio=9.4%2024.0325.77
Mamba-2.8BBackbone=Mamba-2.8B, Pruning ratio=0%2024.0325.3
ShortGPTBackbone=Mamba-2.8B, Pruning ratio=10.9%2024.0325.21
ShortGPTBackbone=RWKV-7B, Pruning ratio=18.8%2024.0323.75
ShortGPTBackbone=Mamba-2.8B, Pruning ratio=20.3%2024.0323.61
LaCoTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.0523.6
ShortGPTBackbone=Mamba-2.8B, Pruning ratio=25%2024.0323.26
LLMPrunerTrain-Free=false, Base Model=Llama 2 7B, Compression Ratio=25%2025.0522.9
ShortGPTBackbone=Mamba-2.8B, Pruning ratio=31.3%2024.0322.77
ShortGPTBackbone=RWKV-7B, Pruning ratio=25%2024.0321.59
ShortGPTBackbone=RWKV-7B, Pruning ratio=28.1%2024.0321.31