Knowledge neuron localization on Multilingual knowledge dataset Ar, En, Fr, Ja, Ru, Zh
41.2PCR (Boost)QRNCA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| QRNCABackbone=Llama-2-7B2024.06 | 41.2 | 36 | |
| QRNCA w/ Common NeuronBackbone=Llama-2-7B2024.06 | 10.4 | 8.5 | |
| Knowledge Neuron*Backbone=Llama-2-7B2024.06 | 6.7 | 1.8 | |
| QRNCA wo/ ICABackbone=Llama-2-7B2024.06 | 6.5 | 2.2 | |
| Random NeuronBackbone=Llama-2-7B2024.06 | 2 | 1 | |
| ActivationBackbone=Llama-2-7B2024.06 | 1.1 | 1.1 |