Package Hallucination Evaluation on SO_LY
57.79Hallucination ASRNPA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NPAModel=Gemma-3-12b-it2026.05 | 57.79 | 37.93 | |
| NPAModel=Nemotron-3-Nano-30B-A3B2026.05 | 54.29 | 22.02 | |
| NPA-StealthModel=Nemotron-3-Nano-30B-A3B2026.05 | 52.11 | 27.23 | |
| Normal SkillModel=Nemotron-3-Nano-30B-A3B2026.05 | 50.2 | 21.71 | |
| IPModel=Nemotron-3-Nano-30B-A3B2026.05 | 48.69 | 19.05 | |
| NPAModel=Qwen2.5-Coder-32B-Instruct2026.05 | 23.7 | 39.31 | |
| NPA-StealthModel=Gemma-3-12b-it2026.05 | 19.25 | 74.3 | |
| NPA-StealthModel=Qwen2.5-Coder-32B-Instruct2026.05 | 17.15 | 28.98 | |
| IPModel=Gemma-3-12b-it2026.05 | 15.48 | 6.42 | |
| NPAModel=Qwen2.5-Coder-14B-Instruct2026.05 | 15.32 | 4.84 | |
| Normal SkillModel=Gemma-3-12b-it2026.05 | 14.95 | 3.05 | |
| Normal SkillModel=Qwen2.5-Coder-14B-Instruct2026.05 | 14.77 | 0 | |
| IPModel=Qwen2.5-Coder-14B-Instruct2026.05 | 14.32 | 0 | |
| NPA-StealthModel=Qwen2.5-Coder-14B-Instruct2026.05 | 13.28 | 3.33 | |
| Normal SkillModel=Qwen2.5-Coder-32B-Instruct2026.05 | 9.48 | 3.11 | |
| IPModel=Qwen2.5-Coder-32B-Instruct2026.05 | 8.65 | 2.21 |