Factual Answering on TruthfulQA (Truth, URR)
62.6Truthfulness ScoreDualEdit
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DualEditBase Model=Qwen2.5-7B-Instruct2026.04 | 62.6 | 86.2 | |
| Qwen2.5-7B-InstructBase Model=Qwen2.5-7B-Instruct2026.04 | 62.4 | 100 | |
| ROMEBase Model=Qwen2.5-7B-Instruct2026.04 | 62.3 | 97.7 | |
| STEEREDITBase Model=Qwen2.5-7B-Instruct2026.04 | 62.2 | 97.2 | |
| SFTBase Model=Qwen2.5-7B-Instruct2026.04 | 58.8 | 92.2 | |
| JailbreakEditBase Model=Qwen2.5-7B-Instruct2026.04 | 56.6 | 69.3 | |
| Llama-3-8B-InstructBase Model=Llama-3-8B-Instruct2026.04 | 52.2 | 100 | |
| STEEREDITBase Model=Llama-3-8B-Instruct2026.04 | 52.2 | 98.6 | |
| DualEditBase Model=Llama-3-8B-Instruct2026.04 | 52.1 | 95.7 | |
| ROMEBase Model=Llama-3-8B-Instruct2026.04 | 49.3 | 85.9 | |
| SFTBase Model=Llama-3-8B-Instruct2026.04 | 49 | 81.2 | |
| JailbreakEditBase Model=Llama-3-8B-Instruct2026.04 | 48 | 70.1 | |
| Llama-2-7b-chatBase Model=Llama-2-7b-chat2026.04 | 47.6 | 100 | |
| DualEditBase Model=Llama-2-7b-chat2026.04 | 47.6 | 95.7 | |
| STEEREDITBase Model=Llama-2-7b-chat2026.04 | 47.5 | 97 | |
| ROMEBase Model=Llama-2-7b-chat2026.04 | 47.2 | 90.9 | |
| SFTBase Model=Llama-2-7b-chat2026.04 | 46.9 | 86.7 | |
| JailbreakEditBase Model=Llama-2-7b-chat2026.04 | 45.1 | 70.7 |