# Factuality Evaluation on HaluEval Sum (500 items) Source: [Factuality Evaluation on HaluEval Sum (500 items)]() Collection index: [llms.txt]() Data updated: 2026-05-19T12:42:56.319Z Evaluation of model factuality performance using the specific 500-item summary subset of the HaluEval dataset, reporting MC1 and MC2 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Factuality Evaluation | | Dataset (including any stated split) | HaluEval Sum (500 items) | | Metric | MC1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MC1 Score](): Higher is better; unit: PERCENT. - [MC2 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | MC1 Score | Result date | Report paper | | --- | --- | --- | --- | | GPT-OSS-20B | 63 | Not recorded | 6a0bef07dbc836b87d82c992 | | LLaMA-30B | 50.6 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 47.2 | Not recorded | 6a0bef07dbc836b87d82c992 | | LLaMA-13B | 47 | Not recorded | 6a0bef07dbc836b87d82c992 | | LLaMA-7B | 44.6 | Not recorded | 6a0bef07dbc836b87d82c992 | | Mixtral-8×7B | 43.6 | Not recorded | 6a0bef07dbc836b87d82c992 | | GPT-OSS-120B | 41 | Not recorded | 6a0bef07dbc836b87d82c992 | | Ministral-3-14B-R | 33.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 32.2 | Not recorded | 6a0bef07dbc836b87d82c992 | | DeepSeek-R1-Q-32B | 32.2 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 31.6 | Not recorded | 6a0bef07dbc836b87d82c992 | | Llama-3.3-70B | 31.4 | Not recorded | 6a0bef07dbc836b87d82c992 | | Gemma-3-1B | 30.2 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 30 | Not recorded | 6a0bef07dbc836b87d82c992 | | Qwen3-30B-A3B | 28.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | Gemma-3-4B | 27.4 | Not recorded | 6a0bef07dbc836b87d82c992 | | Gemma-3-27B | 26.6 | Not recorded | 6a0bef07dbc836b87d82c992 | | Phi-4-Reasoning | 26 | Not recorded | 6a0bef07dbc836b87d82c992 | | Qwen3-14B | 24.2 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 19 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 16.4 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 15.4 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 13.6 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 10.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 9.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 8.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 7.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 6.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 3.8 | Not recorded | 6a0bef07dbc836b87d82c992 | | TRACE | 2 | Not recorded | 6a0bef07dbc836b87d82c992 | ### GPT-OSS-20B MC1 Score: 63. Result ID: 6a0c59f8fbc373592c03ddf8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"3.48","Branch":"mix"}. This record does not assert independent reproduction. ### LLaMA-30B MC1 Score: 50.6. Result ID: 6a0c59f8fbc373592c03de06. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"I(M)":"0.13","Branch":"early"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 47.2. Result ID: 6a0c59f8fbc373592c03ddef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma-3-1B","I(M)":"6.54","Branch":"mix"}. This record does not assert independent reproduction. ### LLaMA-13B MC1 Score: 47. Result ID: 6a0c59f8fbc373592c03de04. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"I(M)":"0.16","Branch":"early"}. This record does not assert independent reproduction. ### LLaMA-7B MC1 Score: 44.6. Result ID: 6a0c59f8fbc373592c03de02. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"I(M)":"0.21","Branch":"early"}. This record does not assert independent reproduction. ### Mixtral-8×7B MC1 Score: 43.6. Result ID: 6a0c59f8fbc373592c03ddfc. [Reporting paper]() Recorded evaluation configuration: {"I(M)":"1.30","Branch":"mix"}. This record does not assert independent reproduction. ### GPT-OSS-120B MC1 Score: 41. Result ID: 6a0c59f8fbc373592c03ddfa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"5.66","Branch":"mix"}. This record does not assert independent reproduction. ### Ministral-3-14B-R MC1 Score: 33.8. Result ID: 6a0c59f8fbc373592c03de0a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"0.57","Branch":"early"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 32.2. Result ID: 6a0c59f8fbc373592c03ddf3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma-3-27B","I(M)":"5.18","Branch":"mix"}. This record does not assert independent reproduction. ### DeepSeek-R1-Q-32B MC1 Score: 32.2. Result ID: 6a0c59f8fbc373592c03ddfe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"1.18","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 31.6. Result ID: 6a0c59f8fbc373592c03ddf1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Gemma-3-4B","I(M)":"11.91","Branch":"mix"}. This record does not assert independent reproduction. ### Llama-3.3-70B MC1 Score: 31.4. Result ID: 6a0c59f8fbc373592c03de00. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"I(M)":"0.39","Branch":"early"}. This record does not assert independent reproduction. ### Gemma-3-1B MC1 Score: 30.2. Result ID: 6a0c59f8fbc373592c03ddee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"6.54","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 30. Result ID: 6a0c59f8fbc373592c03de09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Phi-4-Reasoning","I(M)":"0.27","Branch":"early"}. This record does not assert independent reproduction. ### Qwen3-30B-A3B MC1 Score: 28.8. Result ID: 6a0c59f8fbc373592c03ddf6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"3.51","Branch":"mix"}. This record does not assert independent reproduction. ### Gemma-3-4B MC1 Score: 27.4. Result ID: 6a0c59f8fbc373592c03ddf0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"11.91","Branch":"mix"}. This record does not assert independent reproduction. ### Gemma-3-27B MC1 Score: 26.6. Result ID: 6a0c59f8fbc373592c03ddf2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"5.18","Branch":"mix"}. This record does not assert independent reproduction. ### Phi-4-Reasoning MC1 Score: 26. Result ID: 6a0c59f8fbc373592c03de08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"0.27","Branch":"early"}. This record does not assert independent reproduction. ### Qwen3-14B MC1 Score: 24.2. Result ID: 6a0c59f8fbc373592c03ddf4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"I(M)":"2.57","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 19. Result ID: 6a0c59f8fbc373592c03ddfd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Mixtral-8×7B","I(M)":"1.30","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 16.4. Result ID: 6a0c59f8fbc373592c03ddf7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen3-30B-A3B","I(M)":"3.51","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 15.4. Result ID: 6a0c59f8fbc373592c03ddfb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"GPT-OSS-120B","I(M)":"5.66","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 13.6. Result ID: 6a0c59f8fbc373592c03ddf9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"GPT-OSS-20B","I(M)":"3.48","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 10.8. Result ID: 6a0c59f8fbc373592c03de03. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMA-7B","I(M)":"0.21","Branch":"early"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 9.8. Result ID: 6a0c59f8fbc373592c03de01. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Llama-3.3-70B","I(M)":"0.39","Branch":"early"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 8.8. Result ID: 6a0c59f8fbc373592c03de0b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Ministral-3-14B-R","I(M)":"0.57","Branch":"early"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 7.8. Result ID: 6a0c59f8fbc373592c03ddf5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"Qwen3-14B","I(M)":"2.57","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 6.8. Result ID: 6a0c59f8fbc373592c03de05. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMA-13B","I(M)":"0.16","Branch":"early"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 3.8. Result ID: 6a0c59f8fbc373592c03ddff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"DeepSeek-R1-Q-32B","I(M)":"1.18","Branch":"mix"}. This record does not assert independent reproduction. ### TRACE MC1 Score: 2. Result ID: 6a0c59f8fbc373592c03de07. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base Model":"LLaMA-30B","I(M)":"0.13","Branch":"early"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.