Package Hallucination Evaluation on SO_AT
71.99Hallucination ASRNPA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NPAModel=Nemotron-3-Nano-30B-A3B2026.05 | 71.99 | 23.33 | |
| NPAModel=Gemma-3-12b-it2026.05 | 45.74 | 9.88 | |
| Normal SkillModel=Nemotron-3-Nano-30B-A3B2026.05 | 44.8 | 16.94 | |
| IPModel=Nemotron-3-Nano-30B-A3B2026.05 | 43.48 | 13.92 | |
| NPA-StealthModel=Nemotron-3-Nano-30B-A3B2026.05 | 41.25 | 29.26 | |
| NPAModel=Qwen2.5-Coder-32B-Instruct2026.05 | 37.98 | 74.46 | |
| NPA-StealthModel=Gemma-3-12b-it2026.05 | 16.38 | 72.53 | |
| NPA-StealthModel=Qwen2.5-Coder-32B-Instruct2026.05 | 11.35 | 21.56 | |
| Normal SkillModel=Gemma-3-12b-it2026.05 | 8.98 | 5.36 | |
| NPAModel=Qwen2.5-Coder-14B-Instruct2026.05 | 8.89 | 3.17 | |
| NPA-StealthModel=Qwen2.5-Coder-14B-Instruct2026.05 | 8.51 | 4.29 | |
| IPModel=Gemma-3-12b-it2026.05 | 8.13 | 2.7 | |
| Normal SkillModel=Qwen2.5-Coder-14B-Instruct2026.05 | 7.36 | 3.17 | |
| IPModel=Qwen2.5-Coder-14B-Instruct2026.05 | 6.59 | 0 | |
| Normal SkillModel=Qwen2.5-Coder-32B-Instruct2026.05 | 4.68 | 2.4 | |
| IPModel=Qwen2.5-Coder-32B-Instruct2026.05 | 3.89 | 2.96 |