Manipulated Entity Identification on RealNews (test)
50.08Overall PrecisionOurs
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| OursEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=32022.03 | 50.08 | 65.11 | 46.12 | 84.14 | 12.12 | 21.19 | |
| OursEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=22022.03 | 50.02 | 55.11 | 46.5 | 91.76 | 3.7 | 7.11 | |
| OursEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=22022.03 | 50 | 50.04 | 47.79 | 88.06 | 4.63 | 8.8 | |
| OursEntity replacement strategy=Random least frequent entity replacement, Maximum no. of entity replacements=12022.03 | 49.99 | 38.56 | 42.29 | 81.06 | 0 | 0 | |
| OursEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=12022.03 | 49.94 | 48.2 | 46.07 | 84.71 | 6.08 | 11.35 | |
| OursEntity replacement strategy=Random most frequent entity replacement, Maximum no. of entity replacements=32022.03 | 49.83 | 47.71 | 46.83 | 86.06 | 14.03 | 24.13 | |
| OursEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=12022.03 | 49.49 | 45.82 | 44.82 | 85.59 | 9.14 | 16.52 | |
| OursEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=32022.03 | 48.71 | 45.67 | 44.92 | 73.8 | 12.5 | 21.38 | |
| OursEntity replacement strategy=GPT-2 generated entity replacement, Maximum no. of entity replacements=22022.03 | 48.52 | 46.76 | 47.42 | 85.91 | 1.64 | 3.22 |