List your company

Sparse Autoencoder Evaluation on SAEBench intrinsic evaluation Gemma-2-2B

0.7625RAVEL ScoreEnsembling (NB)
0.734420.741710.7490.75629May 21, 2025

Evaluation results

MethodLinks
Ensembling (NB)Ensembling Approach=Naive Bagging, SAE Ensembles Count=8, SAE Architecture=JumpReLU2025.050.76250.99970.01620.39
Ensembling (Boosting)Ensembling Approach=Boosting, SAE Ensembles Count=8, SAE Architecture=JumpReLU2025.050.75210.11680.2
Expanded SAESAE Architecture=JumpReLU2025.050.74680.9780.13770.23
Base SAESAE Architecture=JumpReLU2025.050.73550.9780.09580.6