# Rumor Detection on PHEME (ASR Metrics) Source: [Rumor Detection on PHEME (ASR Metrics)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:40:34.817Z Evaluation of Rumor Detection performance on the PHEME dataset, reporting specific robustness metrics derived from attack methodologies (ASR%). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Rumor Detection | | Dataset (including any stated split) | PHEME | | Metric | DeepWordBug ASR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [DeepWordBug ASR](): Higher is better; unit: PERCENT. - [TFAdjusted ASR](): Higher is better; unit: PERCENT. - [TREPAT ASR](): Higher is better; unit: PERCENT. - [ExplainDrive ASR](): Higher is better; unit: PERCENT. - [Worst-Case ASR](): Higher is better; unit: PERCENT. ## Recorded results | Method | DeepWordBug ASR | Result date | Report paper | | --- | --- | --- | --- | | Raw BERT | 56.86 | Not recorded | 6948d05e423ea42265729da2 | | FIM | 56.53 | Not recorded | 6948d05e423ea42265729da2 | | FAT | 56.32 | Not recorded | 6948d05e423ea42265729da2 | | MASKFil | 52.4 | Not recorded | 6948d05e423ea42265729da2 | | AT | 50.64 | Not recorded | 6948d05e423ea42265729da2 | | SAFER | 47.32 | Not recorded | 6948d05e423ea42265729da2 | | MRAT | 46.04 | Not recorded | 6948d05e423ea42265729da2 | | OutReg | 44.53 | Not recorded | 6948d05e423ea42265729da2 | | FTML | 43.85 | Not recorded | 6948d05e423ea42265729da2 | | Det&Res | 31.79 | Not recorded | 6948d05e423ea42265729da2 | | ARText | 24.23 | Not recorded | 6948d05e423ea42265729da2 | | ARDEL | 21.04 | Not recorded | 6948d05e423ea42265729da2 | | LLM-puri | 19.42 | Not recorded | 6948d05e423ea42265729da2 | | EnsSel | 17.07 | Not recorded | 6948d05e423ea42265729da2 | | LLM-SGA | 16.02 | Not recorded | 6948d05e423ea42265729da2 | | LLM-SGA | 12.08 | Not recorded | 6948d05e423ea42265729da2 | ### Raw BERT DeepWordBug ASR: 56.86. Result ID: 69994fa25698665ec4ba0eef. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### FIM DeepWordBug ASR: 56.53. Result ID: 69994fa25698665ec4ba0ef6. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### FAT DeepWordBug ASR: 56.32. Result ID: 69994fa25698665ec4ba0ef9. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MASKFil DeepWordBug ASR: 52.4. Result ID: 69994fa25698665ec4ba0ef3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### AT DeepWordBug ASR: 50.64. Result ID: 69994fa25698665ec4ba0ef7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SAFER DeepWordBug ASR: 47.32. Result ID: 69994fa25698665ec4ba0ef2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MRAT DeepWordBug ASR: 46.04. Result ID: 69994fa25698665ec4ba0ef8. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OutReg DeepWordBug ASR: 44.53. Result ID: 69994fa25698665ec4ba0ef5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### FTML DeepWordBug ASR: 43.85. Result ID: 69994fa25698665ec4ba0ef4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Det&Res DeepWordBug ASR: 31.79. Result ID: 69994fa25698665ec4ba0ef1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ARText DeepWordBug ASR: 24.23. Result ID: 69994fa25698665ec4ba0efb. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ARDEL DeepWordBug ASR: 21.04. Result ID: 69994fa25698665ec4ba0efc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLM-puri DeepWordBug ASR: 19.42. Result ID: 69994fa25698665ec4ba0ef0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EnsSel DeepWordBug ASR: 17.07. Result ID: 69994fa25698665ec4ba0efd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLM-SGA DeepWordBug ASR: 16.02. Result ID: 69994fa25698665ec4ba0efa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"single"}. This record does not assert independent reproduction. ### LLM-SGA DeepWordBug ASR: 12.08. Result ID: 69994fa25698665ec4ba0efe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"multiple"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.