Circuit Discovery Evaluation on Gemma-2-2B
82ClarityCL-Full (top)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| CL-Full (top)Layer=02025.10 | 82 | 86 | 71 | 2 | |
| CL-Input (top)Layer=42025.10 | 81 | 88 | 71 | 5 | |
| CL-Full (top)Layer=42025.10 | 81 | 89 | 72 | 5 | |
| CL-Input (top)Layer=02025.10 | 80 | 85 | 73 | 2 | |
| CL-Input (top)Layer=152025.10 | 80 | 91 | 83 | 2 | |
| CL-Full (top)Layer=152025.10 | 79 | 92 | 84 | 2 | |
| WL+CL-FullLayer=02025.10 | 68 | 55 | 38 | 2 | |
| CL-Full (top)Layer=232025.10 | 68 | 80 | 66 | 5 | |
| WL+CL-FullLayer=152025.10 | 66 | 81 | 74 | 2 | |
| WL+CL-FullLayer=232025.10 | 65 | 72 | 61 | 5 | |
| CL-FullLayer=02025.10 | 64 | 47 | 30 | 2 | |
| CL-Input (top)Layer=72025.10 | 64 | 75 | 64 | 2 | |
| CL-Full (top)Layer=72025.10 | 64 | 75 | 61 | 2 | |
| CL-Input (top)Layer=232025.10 | 63 | 77 | 63 | 5 | |
| CL-Full (top)Layer=182025.10 | 62 | 76 | 62 | 5 | |
| WL+CL-FullLayer=42025.10 | 60 | 55 | 44 | 5 | |
| CL-InputLayer=02025.10 | 59 | 46 | 31 | 3 | |
| CL-Input (top)Layer=182025.10 | 57 | 72 | 58 | 4 | |
| NeuronpediaLayer=02025.10 | 57 | 70 | 57 | 2 | |
| CL-InputLayer=152025.10 | 56 | 77 | 70 | 2 | |
| CL-FullLayer=152025.10 | 56 | 76 | 69 | 2 | |
| CL-Full (top)Layer=212025.10 | 56 | 73 | 62 | 3 | |
| WL+CL-FullLayer=212025.10 | 55 | 67 | 56 | 2 | |
| MaxAct*Layer=42025.10 | 55 | 74 | 64 | 6 | |
| CL-Input (top)Layer=212025.10 | 54 | 72 | 63 | 3 | |
| MaxAct*Layer=232025.10 | 54 | 78 | 69 | 6 | |
| CL-Full (top)Layer=102025.10 | 53 | 71 | 55 | 2 | |
| CL-FullLayer=212025.10 | 52 | 64 | 54 | 2 | |
| CL-InputLayer=42025.10 | 51 | 45 | 37 | 4 | |
| CL-Input (top)Layer=102025.10 | 50 | 71 | 54 | 2 | |
| CL-FullLayer=42025.10 | 49 | 45 | 36 | 4 | |
| WL+CL-FullLayer=72025.10 | 49 | 46 | 37 | 2 | |
| NeuronpediaLayer=232025.10 | 49 | 76 | 66 | 7 | |
| MaxAct*Layer=02025.10 | 49 | 69 | 60 | 2 | |
| MaxAct*Layer=152025.10 | 49 | 78 | 73 | 2 | |
| NeuronpediaLayer=42025.10 | 48 | 70 | 60 | 6 | |
| MaxAct*Layer=72025.10 | 48 | 70 | 61 | 2 | |
| CL-Full (top)Layer=252025.10 | 46 | 64 | 52 | 5 | |
| MaxAct*Layer=182025.10 | 44 | 71 | 62 | 5 | |
| CL-FullLayer=72025.10 | 43 | 43 | 38 | 2 | |
| CL-FullLayer=182025.10 | 43 | 54 | 47 | 5 | |
| WL+CL-FullLayer=182025.10 | 43 | 54 | 47 | 5 | |
| CL-Input (top)Layer=252025.10 | 43 | 63 | 50 | 6 | |
| NeuronpediaLayer=72025.10 | 43 | 69 | 60 | 2 | |
| CL-FullLayer=232025.10 | 42 | 55 | 49 | 4 | |
| NeuronpediaLayer=152025.10 | 42 | 78 | 75 | 3 | |
| NeuronpediaLayer=182025.10 | 42 | 70 | 62 | 4 | |
| CL-InputLayer=182025.10 | 41 | 53 | 44 | 5 | |
| CL-InputLayer=212025.10 | 41 | 59 | 51 | 3 | |
| CL-InputLayer=232025.10 | 41 | 54 | 48 | 4 | |
| MaxAct*Layer=212025.10 | 39 | 71 | 64 | 3 | |
| WL+CL-FullLayer=252025.10 | 38 | 52 | 47 | 6 | |
| MaxAct*Layer=102025.10 | 38 | 64 | 55 | 2 | |
| CL-InputLayer=72025.10 | 37 | 45 | 40 | 2 | |
| WL+CL-FullLayer=102025.10 | 37 | 44 | 38 | 2 | |
| NeuronpediaLayer=212025.10 | 36 | 71 | 64 | 3 | |
| MaxAct*Layer=252025.10 | 36 | 66 | 58 | 6 | |
| NeuronpediaLayer=252025.10 | 32 | 66 | 58 | 6 | |
| CL-InputLayer=102025.10 | 30 | 40 | 35 | 2 | |
| NeuronpediaLayer=102025.10 | 30 | 60 | 54 | 2 | |
| CL-FullLayer=102025.10 | 29 | 40 | 36 | 2 | |
| CL-InputLayer=252025.10 | 27 | 43 | 41 | 3 | |
| CL-FullLayer=252025.10 | 27 | 44 | 43 | 4 | |
| CL-Input (top)Layer=122025.10 | 27 | 63 | 57 | 2 | |
| CL-Full (top)Layer=122025.10 | 27 | 63 | 54 | 2 | |
| WL+CL-FullLayer=122025.10 | 25 | 53 | 46 | 2 | |
| CL-FullLayer=122025.10 | 24 | 51 | 46 | 2 | |
| CL-InputLayer=122025.10 | 19 | 51 | 46 | 2 | |
| MaxAct*Layer=122025.10 | 17 | 57 | 53 | 2 | |
| NeuronpediaLayer=122025.10 | 14 | 55 | 53 | 2 |