# Truthfulness on TruthfulQA (Metric: TruthfulQA) Source: [Truthfulness on TruthfulQA (Metric: TruthfulQA)]() Collection index: [llms.txt]() Data updated: 2026-05-12T16:07:04.308Z Evaluation of model performance on the TruthfulQA dataset, reporting the score specifically labeled as 'TruthfulQA'. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Truthfulness | | Dataset (including any stated split) | TruthfulQA | | Metric | TruthfulQA | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [TruthfulQA](): Higher is better; unit: PERCENT. ## Recorded results | Method | TruthfulQA | Result date | Report paper | | --- | --- | --- | --- | | DPO + MaPPO | 59.2 | Not recorded | 6a02b4a6dbc836b87d824e66 | | DPO | 57.1 | Not recorded | 6a02b4a6dbc836b87d824e66 | | IT | 56.4 | Not recorded | 6a02b4a6dbc836b87d824e66 | | I-DPO + MaPPO | 56.2 | Not recorded | 6a02b4a6dbc836b87d824e66 | | I-DPO | 55.9 | Not recorded | 6a02b4a6dbc836b87d824e66 | | O-LoRA | 42.9 | Not recorded | 69e704ca7d0172140ec7ef96 | | Moderate-Gi | 42.8 | Not recorded | 69e704ca7d0172140ec7ef96 | | Moderate-Gi | 42.5 | Not recorded | 69e704ca7d0172140ec7ef96 | | O-LoRA | 42.3 | Not recorded | 69e704ca7d0172140ec7ef96 | | Cosine | 42 | Not recorded | 69ba31ab0636e5bf4afc09be | | Moderate-Gi | 41.5 | Not recorded | 69e704ca7d0172140ec7ef96 | | Cosine | 41.1 | Not recorded | 69ba31ab0636e5bf4afc09be | | EWC | 40.5 | Not recorded | 69e704ca7d0172140ec7ef96 | | WSD | 40.4 | Not recorded | 69ba31ab0636e5bf4afc09be | | Random | 40.1 | Not recorded | 69e704ca7d0172140ec7ef96 | | O-LoRA | 40 | Not recorded | 69e704ca7d0172140ec7ef96 | | WSD | 39.8 | Not recorded | 69ba31ab0636e5bf4afc09be | | WSD | 39.7 | Not recorded | 69ba31ab0636e5bf4afc09be | | Baseline | 39.7 | Not recorded | 69e704ca7d0172140ec7ef96 | | KL | 39.7 | Not recorded | 69e704ca7d0172140ec7ef96 | | Linear | 39.4 | Not recorded | 69ba31ab0636e5bf4afc09be | | Linear | 39 | Not recorded | 69ba31ab0636e5bf4afc09be | | Random | 38.6 | Not recorded | 69e704ca7d0172140ec7ef96 | | KL | 38.6 | Not recorded | 69e704ca7d0172140ec7ef96 | | Random | 38.4 | Not recorded | 69e704ca7d0172140ec7ef96 | | Baseline | 38.2 | Not recorded | 69e704ca7d0172140ec7ef96 | | Grad. Clip | 38.2 | Not recorded | 69e704ca7d0172140ec7ef96 | | Warmup-Stable-Only (WSO) | 38.1 | Not recorded | 69ba31ab0636e5bf4afc09be | | EWC | 38.1 | Not recorded | 69e704ca7d0172140ec7ef96 | | EWC | 38 | Not recorded | 69e704ca7d0172140ec7ef96 | | KL | 37.8 | Not recorded | 69e704ca7d0172140ec7ef96 | | Baseline | 37.8 | Not recorded | 69e704ca7d0172140ec7ef96 | ### DPO + MaPPO TruthfulQA: 59.2. Result ID: 6a03501347f34ce924e8ab13. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### DPO TruthfulQA: 57.1. Result ID: 6a03501347f34ce924e8ab12. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### IT TruthfulQA: 56.4. Result ID: 6a03501347f34ce924e8ab11. [Reporting paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### I-DPO + MaPPO TruthfulQA: 56.2. Result ID: 6a03501347f34ce924e8ab15. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### I-DPO TruthfulQA: 55.9. Result ID: 6a03501347f34ce924e8ab14. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen2.5-7B-Instruct"}. This record does not assert independent reproduction. ### O-LoRA TruthfulQA: 42.9. Result ID: 69e749f047f34ce924ce0067. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### Moderate-Gi TruthfulQA: 42.8. Result ID: 69e749f047f34ce924ce0076. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3"}. This record does not assert independent reproduction. ### Moderate-Gi TruthfulQA: 42.5. Result ID: 69e749f047f34ce924ce006a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### O-LoRA TruthfulQA: 42.3. Result ID: 69e749f047f34ce924ce0074. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3"}. This record does not assert independent reproduction. ### Cosine TruthfulQA: 42. Result ID: 69ba5e5b47f34ce924a41f93. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"Cosine","alpha\_pre":"0.1","alpha\_mid":"1.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### Moderate-Gi TruthfulQA: 41.5. Result ID: 69e749f047f34ce924ce0070. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA-3.1"}. This record does not assert independent reproduction. ### Cosine TruthfulQA: 41.1. Result ID: 69ba5e5b47f34ce924a41f92. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"Cosine","alpha\_pre":"0.1","alpha\_mid":"0.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### EWC TruthfulQA: 40.5. Result ID: 69e749f047f34ce924ce0075. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen3"}. This record does not assert independent reproduction. ### WSD TruthfulQA: 40.4. Result ID: 69ba5e5b47f34ce924a41f8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"WSD","alpha\_pre":"1.0","alpha\_mid":"0.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### Random TruthfulQA: 40.1. Result ID: 69e749f047f34ce924ce0072. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3"}. This record does not assert independent reproduction. ### O-LoRA TruthfulQA: 40. Result ID: 69e749f047f34ce924ce006e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA-3.1"}. This record does not assert independent reproduction. ### WSD TruthfulQA: 39.8. Result ID: 69ba5e5b47f34ce924a41f90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"WSD","alpha\_pre":"0.1","alpha\_mid":"0.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### WSD TruthfulQA: 39.7. Result ID: 69ba5e5b47f34ce924a41f91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"WSD","alpha\_pre":"0.1","alpha\_mid":"1.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### Baseline TruthfulQA: 39.7. Result ID: 69e749f047f34ce924ce0071. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3"}. This record does not assert independent reproduction. ### KL TruthfulQA: 39.7. Result ID: 69e749f047f34ce924ce0073. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen3"}. This record does not assert independent reproduction. ### Linear TruthfulQA: 39.4. Result ID: 69ba5e5b47f34ce924a41f95. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"Linear","alpha\_pre":"0.1","alpha\_mid":"1.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### Linear TruthfulQA: 39. Result ID: 69ba5e5b47f34ce924a41f94. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"Linear","alpha\_pre":"0.1","alpha\_mid":"0.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### Random TruthfulQA: 38.6. Result ID: 69e749f047f34ce924ce006c. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA-3.1"}. This record does not assert independent reproduction. ### KL TruthfulQA: 38.6. Result ID: 69e749f047f34ce924ce006d. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA-3.1"}. This record does not assert independent reproduction. ### Random TruthfulQA: 38.4. Result ID: 69e749f047f34ce924ce0065. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### Baseline TruthfulQA: 38.2. Result ID: 69e749f047f34ce924ce0064. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### Grad. Clip TruthfulQA: 38.2. Result ID: 69e749f047f34ce924ce0069. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### Warmup-Stable-Only (WSO) TruthfulQA: 38.1. Result ID: 69ba5e5b47f34ce924a41f8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"1B","Pre-training Scheduler":"Warmup-Stable-Only (WSO)","alpha\_pre":"1.0","alpha\_mid":"1.0","Pre-training tokens":"2T","Mid-training tokens":"500B","Training Stage":"Supervised fine-tuned (SFT)"}. This record does not assert independent reproduction. ### EWC TruthfulQA: 38.1. Result ID: 69e749f047f34ce924ce0068. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### EWC TruthfulQA: 38. Result ID: 69e749f047f34ce924ce006f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA-3.1"}. This record does not assert independent reproduction. ### KL TruthfulQA: 37.8. Result ID: 69e749f047f34ce924ce0066. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen2.5"}. This record does not assert independent reproduction. ### Baseline TruthfulQA: 37.8. Result ID: 69e749f047f34ce924ce006b. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA-3.1"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.