Manipulated Article Detection on RealNews (test)
0.8459AccuracyOurs (w/o Entity Identification Objective)
Evaluation results
| Method | Links | |
|---|---|---|
| Ours (w/o Entity Identification Objective)Entity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=32022.03 | 0.8459 | |
| OursEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=32022.03 | 0.8439 | |
| ROBERTaEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=32022.03 | 0.8426 | |
| ROBERTaEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=32022.03 | 0.8393 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=32022.03 | 0.8386 | |
| OursEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=32022.03 | 0.8384 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=32022.03 | 0.7911 | |
| OursEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=32022.03 | 0.7905 | |
| OursEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=22022.03 | 0.7899 | |
| ROBERTaEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=32022.03 | 0.7879 | |
| ROBERTaEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=22022.03 | 0.7837 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=22022.03 | 0.7836 | |
| OursEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=22022.03 | 0.7826 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=22022.03 | 0.7798 | |
| ROBERTaEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=22022.03 | 0.7686 | |
| OursEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=22022.03 | 0.748 | |
| ROBERTaEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=22022.03 | 0.7412 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=22022.03 | 0.7384 | |
| OursEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=12022.03 | 0.6825 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=12022.03 | 0.6725 | |
| OursEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=12022.03 | 0.6721 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=12022.03 | 0.6716 | |
| ROBERTaEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=12022.03 | 0.6709 | |
| ROBERTaEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=12022.03 | 0.6709 | |
| Ours (w/o Entity Identification Objective)Entity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=12022.03 | 0.6699 | |
| OursEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=12022.03 | 0.6584 | |
| ROBERTaEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=12022.03 | 0.6556 |