Truthful Question Answering on TruthfulQA (MC1 & MC2)
81.94MC1 ScoreMARI
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MARIModel=Qwen2.5-32B2026.05 | 81.94 | 70.59 | |
| MARIModel=Qwen2.5-14B2026.05 | 67.93 | 71.92 | |
| MARIModel=Llama-2-13B2026.05 | 66.67 | 64.96 | |
| MARIModel=Qwen2-7B2026.05 | 65.74 | 68.84 | |
| MARIModel=Llama-2-7B2026.05 | 64.35 | 61.13 | |
| MARIModel=Llama-3-8B2026.05 | 61.81 | 67.39 | |
| ReFTModel=Llama-2-13B2026.05 | 59.8 | 55.6 | |
| ReFTModel=Qwen2.5-32B2026.05 | 55.6 | 48.9 | |
| ReFTModel=Qwen2.5-14B2026.05 | 52.33 | 62.8 | |
| ReFTModel=Llama-3-8B2026.05 | 50.58 | 52.51 | |
| ReFTModel=Llama-2-7B2026.05 | 50.46 | 50.2 | |
| ReFTModel=Qwen2-7B2026.05 | 49.83 | 59.69 | |
| NL-ITIModel=Qwen2.5-32B2026.05 | 47.92 | 66.23 | |
| NL-ITIModel=Qwen2.5-14B2026.05 | 46.84 | 68.33 | |
| ITIModel=Qwen2.5-32B2026.05 | 46.78 | 64.43 | |
| CAAModel=Qwen2.5-32B2026.05 | 44.77 | 60.05 | |
| VanillaModel=Qwen2.5-32B2026.05 | 43.98 | 59.81 | |
| ITIModel=Qwen2.5-14B2026.05 | 42.2 | 63.65 | |
| CAAModel=Qwen2.5-14B2026.05 | 40.44 | 62.25 | |
| VanillaModel=Qwen2.5-14B2026.05 | 39.81 | 60.71 | |
| NL-ITIModel=Llama-3-8B2026.05 | 36.19 | 53.12 | |
| NL-ITIModel=Llama-2-13B2026.05 | 36.19 | 53.12 | |
| ITIModel=Llama-3-8B2026.05 | 35.45 | 53.95 | |
| ITIModel=Llama-2-13B2026.05 | 35.45 | 53.95 | |
| CAAModel=Llama-2-7B2026.05 | 33.8 | 46.9 | |
| CAAModel=Llama-2-13B2026.05 | 33.5 | 51.9 | |
| NL-ITIModel=Qwen2-7B2026.05 | 32.84 | 52.33 | |
| VanillaModel=Llama-2-13B2026.05 | 32.76 | 50.75 | |
| VanillaModel=Llama-2-7B2026.05 | 32.03 | 49.51 | |
| NL-ITIModel=Llama-2-7B2026.05 | 31.3 | 49.38 | |
| ITIModel=Qwen2-7B2026.05 | 31.12 | 52.32 | |
| ITIModel=Llama-2-7B2026.05 | 30.81 | 49.8 | |
| CAAModel=Llama-3-8B2026.05 | 29.64 | 46.95 | |
| VanillaModel=Llama-3-8B2026.05 | 28.7 | 45.03 | |
| CAAModel=Qwen2-7B2026.05 | 28.44 | 49.25 | |
| VanillaModel=Qwen2-7B2026.05 | 26.75 | 48.31 |