Task Execution on IHEval
100Language Detection (Reference)Llama3.1-8B
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Llama3.1-8BBackbone=Llama3.1-8B2026.04 | 100 | 95.4 | 0.6 | 72 | 47.8 | 7.2 | 84.4 | 74.2 | 21.2 | 55.9 | |
| Llama3.1-8B-CoTBackbone=Llama3.1-8B, reasoning_mode=Chain of Thought2026.04 | 100 | 99 | 10.9 | 53.5 | 40 | 6.7 | 67.3 | 67.8 | 8.2 | 50.4 | |
| Llama3.1-8B-NSBackbone=Llama3.1-8B, inference_mode=Neuro-Symbolic2026.04 | 100 | 95.4 | 0.6 | 71.9 | 48.1 | 7.2 | 83.1 | 76 | 20.8 | 55.9 | |
| Llama3.1-8B-NSHA-HCALBackbone=Llama3.1-8B, Alignment=NSHA-HCAL2026.04 | 100 | 95.8 | 1 | 72.1 | 49.1 | 7.8 | 84.5 | 76.3 | 22.9 | 56.6 | |
| Llama3.1-8B-NSHA-DPOBackbone=Llama3.1-8B, Alignment=NSHA-DPO2026.04 | 99.2 | 47.9 | 15.2 | 63.4 | 42.8 | 7.9 | 81 | 75.8 | 18 | 50.1 | |
| Qwen3-4B-it-NSHA-SFTBackbone=Qwen3-4B-it, Alignment=NSHA-SFT2026.04 | 98.3 | 92.5 | 34.5 | 72.2 | 64.7 | 25.7 | 73.1 | 54.2 | 19.7 | 59.4 | |
| Qwen3-4B-itBackbone=Qwen3-4B-it2026.04 | 95.8 | 79.8 | 4.5 | 72.1 | 55.3 | 16.3 | 70.5 | 59.6 | 0.1 | 50.4 | |
| Qwen3-4B-it-NSHA-DPOBackbone=Qwen3-4B-it, Alignment=NSHA-DPO2026.04 | 95.8 | 89.8 | 70.7 | 72.3 | 65.5 | 23.9 | 65.5 | 60 | 0.8 | 60.5 | |
| Qwen3-4B-it-NSHA-HCALBackbone=Qwen3-4B-it, Alignment=NSHA-HCAL2026.04 | 95.4 | 80.4 | 6 | 72.3 | 55.2 | 16 | 69.5 | 59.5 | 0.1 | 50.5 | |
| Qwen3-4B-it-NSBackbone=Qwen3-4B-it, inference_mode=Neuro-Symbolic2026.04 | 95 | 80.6 | 4.6 | 71.9 | 55.2 | 16.5 | 70.6 | 59.6 | 0.1 | 50.5 | |
| Qwen3-4B-it-CoTBackbone=Qwen3-4B-it, reasoning_mode=Chain of Thought2026.04 | 94.2 | 69.4 | 39 | 67 | 36.4 | 19.4 | 70.4 | 58.8 | 0 | 50.5 | |
| Llama3.1-8B-NSHA-SFTBackbone=Llama3.1-8B, Alignment=NSHA-SFT2026.04 | 54.6 | 8.8 | 0 | 6.8 | 5.4 | 2.9 | 13.9 | 1.7 | 7.4 | 11.3 |