List your company
ResearchFormerly WizWand

Indirect Object Identification on IOI

0.15Last-Token KL DivergenceFAP
0.09240.48120.871.2588Apr 18, 2026
Updated 6mo ago

Evaluation results

MethodLinks
FAPModel=Gemma-2-2B, Budget (K)=8002026.040.15
FAP-SynergyModel=Gemma-2-2B, Budget (K)=8002026.040.15
FAPModel=Llama-3.2-1B, Budget (K)=8002026.040.22
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=8002026.040.22
FAPModel=Gemma-2-2B, Budget (K)=4002026.040.3
FAP-SynergyModel=Gemma-2-2B, Budget (K)=4002026.040.3
FAPModel=Gemma-2-2B, Budget (K)=2002026.040.52
FAP-SynergyModel=Gemma-2-2B, Budget (K)=2002026.040.52
FAPModel=Llama-3.2-1B, Budget (K)=4002026.040.53
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=4002026.040.53
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=8002026.040.64
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=8002026.040.7
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=4002026.040.72
FAP-SynergyModel=Gemma-2-2B, Budget (K)=1002026.040.73
FAPModel=Gemma-2-2B, Budget (K)=1002026.040.74
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=2002026.040.76
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=1002026.040.77
ACDC-Style PruningModel=Gemma-2-2B, Budget (K)=502026.040.81
FAP-SynergyModel=Gemma-2-2B, Budget (K)=502026.040.82
FAPModel=Llama-3.2-1B, Budget (K)=2002026.040.85
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=2002026.040.85
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=8002026.040.87
FAPModel=Gemma-2-2B, Budget (K)=502026.040.91
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=4002026.040.96
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=4002026.041.07
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=1002026.041.12
FAPModel=Llama-3.2-1B, Budget (K)=1002026.041.13
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=8002026.041.13
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=2002026.041.18
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=4002026.041.19
FAP-SynergyModel=Llama-3.2-1B, Budget (K)=502026.041.22
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=2002026.041.22
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=1002026.041.24
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=1002026.041.25
ACDC-Style PruningModel=Llama-3.2-1B, Budget (K)=502026.041.26
Activation-MagnitudeModel=Gemma-2-2B, Budget (K)=502026.041.29
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=2002026.041.32
FAPModel=Llama-3.2-1B, Budget (K)=502026.041.33
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=1002026.041.52
Activation-MagnitudeModel=Llama-3.2-1B, Budget (K)=502026.041.59