# Claim improvement suggestion on Subset of 135,828 claims Source: [Claim improvement suggestion on Subset of 135,828 claims]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:28:54.974Z Evaluation of model performance on suggesting improvements for claims within the 'Subset of 135,828 claims' dataset, measured using Accuracy, Macro F1, and specialized F1 scores for clarification, typos, and links. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Claim improvement suggestion | | Dataset (including any stated split) | Subset of 135,828 claims | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 7 of 7 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Macro F1](): Higher is better; unit: PERCENT. - [Clarification F1](): Higher is better; unit: PERCENT. - [Typo F1](): Higher is better; unit: PERCENT. - [Links F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | FT-DeBERTa | 62 | Not recorded | 68fa6f801e209131cea46090 | | FT-DeBERTa | 60.3 | Not recorded | 68fa6f801e209131cea46090 | | FT-DeBERTa | 59.9 | Not recorded | 68fa6f801e209131cea46090 | | FT-ELECTRA | 57.5 | Not recorded | 68fa6f801e209131cea46090 | | FT-ELECTRA | 56.2 | Not recorded | 68fa6f801e209131cea46090 | | FT-ELECTRA | 56 | Not recorded | 68fa6f801e209131cea46090 | | Random baseline | 33.4 | Not recorded | 68fa6f801e209131cea46090 | ### FT-DeBERTa Accuracy: 62. Result ID: 6990c75c3a6c314849033b18. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Context":"Main thesis"}. This record does not assert independent reproduction. ### FT-DeBERTa Accuracy: 60.3. Result ID: 6990c75c3a6c314849033b17. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Context":"Parent claim"}. This record does not assert independent reproduction. ### FT-DeBERTa Accuracy: 59.9. Result ID: 6990c75c3a6c314849033b16. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Context":"None"}. This record does not assert independent reproduction. ### FT-ELECTRA Accuracy: 57.5. Result ID: 6990c75c3a6c314849033b15. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Context":"Main thesis"}. This record does not assert independent reproduction. ### FT-ELECTRA Accuracy: 56.2. Result ID: 6990c75c3a6c314849033b14. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Context":"Parent claim"}. This record does not assert independent reproduction. ### FT-ELECTRA Accuracy: 56. Result ID: 6990c75c3a6c314849033b13. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Context":"None"}. This record does not assert independent reproduction. ### Random baseline Accuracy: 33.4. Result ID: 6990c75c3a6c314849033b19. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.