Knowledge Editing on CHED
95.7SSUIT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SUIT2025.09 | 95.7 | 92 | 95.6 | 94.3 | 91.2 | 93.4 | 93.7 | |
| EMMETBase Model=Llama3-8B-Instruct2025.05 | 93.5 | 78 | 95.3 | 92.5 | 90.5 | — | — | |
| AlphaEdit2025.09 | 92.7 | 88.6 | 94.2 | 90.4 | 87.9 | 92 | 91 | |
| CoRE-p+rBase Model=Llama3-8B-Instruct2025.05 | 89 | 55.4 | 95.1 | 89 | 83.1 | — | — | |
| CoRE-pBase Model=Llama3-8B-Instruct2025.05 | 87.7 | 49.8 | 94.8 | 87 | 80.1 | — | — | |
| MEMITBase Model=Llama3-8B-Instruct2025.05 | 86.4 | 46.4 | 93.6 | 82.2 | 72.7 | — | — | |
| CoRE-p+rBase Model=Mistral-7B-Instruct2025.05 | 83.5 | 63 | 88.9 | 83.8 | 79.8 | — | — | |
| CoRE-pBase Model=Mistral-7B-Instruct2025.05 | 82.3 | 58.8 | 87.3 | 80.3 | 74.2 | — | — | |
| MEMITBase Model=Mistral-7B-Instruct2025.05 | 80.1 | 50.5 | 84 | 78 | 71 | — | — | |
| EMMETBase Model=Mistral-7B-Instruct2025.05 | 79.6 | 61.5 | 85.2 | 77.6 | 74.3 | — | — | |
| MEMIT2025.09 | 75.4 | 73.6 | 77.8 | 74.1 | 70.4 | 75.7 | 74.5 | |
| FT-MBase Model=Llama3-8B-Instruct2025.05 | 69.4 | 67 | 69.6 | 67.1 | 63.7 | — | — | |
| JEEPBase Model=Llama3-8B-Instruct2025.05 | 67.9 | 35.9 | 82.3 | 65.2 | 56 | — | — | |
| PMETBase Model=Llama3-8B-Instruct2025.05 | 67.8 | 36 | 85.2 | 65.7 | 57.6 | — | — | |
| PMETBase Model=Mistral-7B-Instruct2025.05 | 67.6 | 41.5 | 76.3 | 63.9 | 56.7 | — | — | |
| JEEPBase Model=Mistral-7B-Instruct2025.05 | 48.7 | 21.2 | 64.7 | 42.1 | 35.1 | — | — | |
| FT-MBase Model=Mistral-7B-Instruct2025.05 | 44.3 | 36.6 | 42.1 | 43 | 36.9 | — | — | |
| BaseBase Model=Llama3-8B-Instruct2025.05 | 1.1 | 0.4 | 40.1 | 0.9 | 0.9 | — | — | |
| BaseBase Model=Mistral-7B-Instruct2025.05 | 0.9 | 0.3 | 32.6 | 1.1 | 1.1 | — | — |