Knowledge neuron localization on Domain knowledge dataset Bio, Phys, Chem, Math, CS, Geo
4.4PCR (Boost)QRNCA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QRNCABackbone=Llama-2-7B2024.06 | 4.4 | 5.6 | |
| QRNCA w/ Common NeuronBackbone=Llama-2-7B2024.06 | 2.8 | 1.8 | |
| QRNCA wo/ ICABackbone=Llama-2-7B2024.06 | 2.5 | 1.1 | |
| Random NeuronBackbone=Llama-2-7B2024.06 | 1 | 0.55 | |
| ActivationBackbone=Llama-2-7B2024.06 | 1 | 1 | |
| Knowledge Neuron*Backbone=Llama-2-7B2024.06 | 1 | 1 |