Hallucination Correction on WikiBigEdit
1Error Rate (ERR)GRACE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GRACEModel=LLaMA-3-8B2026.03 | 1 | 216 | 58 | |
| ELDERModel=LLaMA-3-8B2026.03 | 1 | 178 | 48 | |
| MELOModel=LLaMA-3-8B2026.03 | 1 | 165 | 47 | |
| SoLAModel=LLaMA-3-8B2026.03 | 1 | 162 | 44 | |
| GRACEModel=DeepSeek-R1-8B2026.03 | 1 | 487 | 793 | |
| SoLAModel=DeepSeek-R1-8B2026.03 | 1 | 248 | 412 | |
| ELDERModel=Qwen2-7B2026.03 | 1 | 225 | 197 | |
| MELOModel=Qwen2-7B2026.03 | 1 | 203 | 143 | |
| SoLAModel=Qwen2-7B2026.03 | 1 | 199 | 109 | |
| CLEARModel=DeepSeek-R1-8B2026.03 | 1.02 | 28,110 | 1.48 | |
| CLEARModel=LLaMA-3-8B2026.03 | 1.03 | 74,384 | 1.52 | |
| ELDERModel=DeepSeek-R1-8B2026.03 | 1.03 | 304 | 492 | |
| MELOModel=DeepSeek-R1-8B2026.03 | 1.05 | 263 | 445 | |
| CLEARModel=Qwen2-7B2026.03 | 1.05 | 35,396 | 4.26 | |
| CMRModel=LLaMA-3-8B2026.03 | 2.86 | 169,452 | 4.49 | |
| EWCModel=DeepSeek-R1-8B2026.03 | 2.86 | 47,846 | 3.89 | |
| EWCModel=LLaMA-3-8B2026.03 | 3.58 | 251,117 | 4.93 | |
| CMRModel=DeepSeek-R1-8B2026.03 | 3.6 | 34,623 | 5.51 | |
| EWCModel=Qwen2-7B2026.03 | 5.61 | 61,834 | 14.65 | |
| CMRModel=Qwen2-7B2026.03 | 6.28 | 48,629 | 16.89 | |
| GRACEModel=Qwen2-7B2026.03 | 16.88 | 299 | 518 | |
| SERACModel=LLaMA-3-8B2026.03 | 60.17 | 215 | 59 | |
| SERACModel=Qwen2-7B2026.03 | 62.12 | 304 | 523 | |
| SERACModel=DeepSeek-R1-8B2026.03 | 82.72 | 493 | 831 |