List your company
ResearchFormerly WizWand

Doc-String Prediction on Doc-String

0.12Last-Token KL DivergenceFAP
0.08960.29480.50.7052Apr 18, 2026
Updated 6mo ago

Evaluation results

MethodLinks
FAPModel=Gemma-2-2B, Budget (K)=8002026.040.12
FAP-SynergyModel=Gemma-2-2B, Budget (K)=8002026.040.12
FAPModel=Llama-3.2-1B, Budget (K)=8002026.040.14
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=8002026.040.14
FAPModel=Gemma-2-2B, Budget (K)=4002026.040.21
FAP-SynergyModel=Gemma-2-2B, Budget (K)=4002026.040.21
FAP-SynergyModel=Gemma-2-2B, Budget (K)=2002026.040.29
FAPModel=Gemma-2-2B, Budget (K)=2002026.040.3
FAPModel=Llama-3.2-1B, Budget (K)=4002026.040.32
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=4002026.040.32
FAPModel=Gemma-2-2B, Budget (K)=1002026.040.36
FAP-SynergyModel=Gemma-2-2B, Budget (K)=1002026.040.36
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=8002026.040.36
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=8002026.040.36
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=4002026.040.38
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=2002026.040.39
FAP-SynergyModel=Gemma-2-2B, Budget (K)=502026.040.4
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=4002026.040.4
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=502026.040.4
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=1002026.040.4
FAPModel=Gemma-2-2B, Budget (K)=502026.040.41
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=1002026.040.42
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=2002026.040.42
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=502026.040.43
FAPModel=Llama-3.2-1B, Budget (K)=2002026.040.53
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=2002026.040.53
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=1002026.040.68
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=8002026.040.68
FAPModel=Llama-3.2-1B, Budget (K)=1002026.040.69
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=502026.040.74
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=8002026.040.74
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=4002026.040.75
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=1002026.040.76
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=2002026.040.76
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=4002026.040.77
FAPModel=Llama-3.2-1B, Budget (K)=502026.040.78
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=502026.040.78
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=2002026.040.85
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=502026.040.88
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=1002026.040.88