Question Answering on TruthfulQA (TruthfulQA Score)
63TruthfulQA ScoreTI-DPO
Evaluation Results
| Method | Links | |
|---|---|---|
| TI-DPOBackbone=LLaMA-3.1-8B2025.05 | 63 | |
| GRPOBackbone=LLaMA-3.1-8B2025.05 | 62 | |
| TPOBackbone=LLaMA-3.1-8B2025.05 | 61 | |
| CPOBackbone=LLaMA-3.1-8B2025.05 | 60 | |
| SELF-EVOLVING CLEANINGBase Model=LLaMA-3.1-8B, Selection Proportion=0.62025.02 | 59.58 | |
| KTOBackbone=LLaMA-3.1-8B2025.05 | 59 | |
| DPOBackbone=LLaMA-3.1-8B2025.05 | 58 | |
| TDPOBackbone=LLaMA-3.1-8B2025.05 | 57 | |
| FIXED-MODEL CLEANINGBase Model=LLaMA-3.1-8B, Selection Proportion=0.62025.02 | 56.02 | |
| SFTBackbone=LLaMA-3.1-8B2025.05 | 56 | |
| RHOBase Model=LLaMA-3.1-8B, Selection Proportion=0.62025.02 | 54.63 | |
| SIMPOBackbone=LLaMA-3.1-8B2025.05 | 54 | |
| IPOBackbone=LLaMA-3.1-8B2025.05 | 53 | |
| SELF-EVOLVING CLEANINGBase Model=LLaMA-3.2-3B, Selection Proportion=0.62025.02 | 51.07 | |
| ABL-SOC-110M-2Zero-shot=true2026.03 | 50.41 | |
| DS² (10K)Base Model=LLaMA-3.1-8B, Token Budget=10K2025.02 | 49.57 | |
| FIXED-MODEL CLEANINGBase Model=LLaMA-3.2-3B, Selection Proportion=0.62025.02 | 48.96 | |
| SUB-SOC-110M-1Zero-shot=true2026.03 | 48.91 | |
| UNIFORM RANDOM (50K×0.6)Base Model=LLaMA-3.1-8B, Token Budget=50K, Selection Proportion=0.62025.02 | 48.68 | |
| ABL-SOC-110M-3Zero-shot=true2026.03 | 48.42 | |
| SUB-SOC-110M-2Zero-shot=true2026.03 | 48.07 | |
| FULL TOKENS (50K)Base Model=LLaMA-3.1-8B, Token Budget=50K2025.02 | 47.51 | |
| GPT-Neo-125MZero-shot=true2026.03 | 45.58 | |
| RHOBase Model=LLaMA-3.2-3B, Selection Proportion=0.62025.02 | 45.57 | |
| SELF-EVOLVING CLEANINGBase Model=Mistral-7B-v0.3, Selection Proportion=0.62025.02 | 45.41 | |
| BASEBase Model=LLaMA-3.1-8B2025.02 | 45.1 | |
| ABL-SOC-110M-1Zero-shot=true2026.03 | 44.66 | |
| PLDRv51-SOC-110M-1Zero-shot=true2026.03 | 44.59 | |
| FIXED-MODEL CLEANINGBase Model=Mistral-7B-v0.3, Selection Proportion=0.62025.02 | 44.52 | |
| PLDRv51-SOC-110M-2Zero-shot=true2026.03 | 44.33 | |
| PLDRv51-SOC-110M-4Zero-shot=true2026.03 | 44.33 | |
| DS² (10K)Base Model=Mistral-7B-v0.3, Token Budget=10K2025.02 | 44.24 | |
| PLDRv51-SOC-110M-3Zero-shot=true2026.03 | 44.17 | |
| RHOBase Model=Mistral-7B-v0.3, Selection Proportion=0.62025.02 | 43.92 | |
| UNIFORM RANDOM (50K×0.6)Base Model=Mistral-7B-v0.3, Token Budget=50K, Selection Proportion=0.62025.02 | 43.82 | |
| UNIFORM RANDOM (50K×0.6)Base Model=LLaMA-3.2-3B, Token Budget=50K, Selection Proportion=0.62025.02 | 43.79 | |
| FULL TOKENS (50K)Base Model=Mistral-7B-v0.3, Token Budget=50K2025.02 | 43.67 | |
| DS² (10K)Base Model=LLaMA-3.2-3B, Token Budget=10K2025.02 | 43.35 | |
| FULL TOKENS (50K)Base Model=LLaMA-3.2-3B, Token Budget=50K2025.02 | 43.32 | |
| PLDRv51-SOC-110M-5Zero-shot=true2026.03 | 43 | |
| BASEBase Model=Mistral-7B-v0.32025.02 | 42.56 | |
| BASEBase Model=LLaMA-3.2-3B2025.02 | 39.39 | |
| Vicuna-13B (all)#Token=370M2026.01 | 35 | |
| Alpaca-13B#Token=4.4M2026.01 | 30 | |
| LLaMA-13B#Token=1T2026.01 | 26 | |
| B4GModel=GEMMA-2-9B, Task=model identity2026.03 | 5.9 | |
| B4GModel=LLAMA2-13B, Task=access control2026.03 | 5.89 | |
| B4GModel=QWEN2.5-7B, Task=access control2026.03 | 5.82 | |
| B4GModel=QWEN2.5-7B, Task=safety enhancement2026.03 | 5.66 | |
| B4GModel=GEMMA-2-9B, Task=access control2026.03 | 5.6 | |
| B4GModel=LLAMA2-13B, Task=safety enhancement2026.03 | 5.56 | |
| B4GModel=LLAMA2-13B, Task=style personalization2026.03 | 5.54 | |
| B4GModel=QWEN2.5-7B, Task=style personalization2026.03 | 5.51 | |
| B4GModel=GEMMA-2-9B, Task=safety enhancement2026.03 | 5.5 | |
| B4GModel=GEMMA-2-9B, Task=style personalization2026.03 | 5.35 | |
| B4GModel=QWEN2.5-7B, Task=model identity2026.03 | 5.32 | |
| B4GModel=LLAMA3.1-8B, Task=style personalization2026.03 | 5.31 | |
| B4GModel=LLAMA3.1-8B, Task=safety enhancement2026.03 | 5.18 | |
| B4GModel=LLAMA3.1-8B, Task=model identity2026.03 | 5.12 | |
| B4GModel=LLAMA3.1-8B, Task=access control2026.03 | 5.1 | |
| B4GModel=LLAMA2-13B, Task=model identity2026.03 | 5.09 |