Abstractive Snippet Generation on Web Document Snippets 100 sample human study WWW '20 (test)
0.97Fluency Agreement (Majority)DMOZ-QB
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DMOZ-QBTraining Corpus=DMOZ, Query-biased=true2020.02 | 0.97 | 0.51 | 51 | 41 | 7 | 1 | -1.34 | |
| DMOZ-QBquery-biased=true2020.02 | 0.91 | 0.4 | 38 | 16 | 6 | 2 | -0.82 | |
| AnchorContextTraining Corpus=AnchorContext, Query-biased=false2020.02 | 0.9 | 0.32 | 0 | 3 | 20 | 77 | 1.71 | |
| CNN-DMquery-biased=false2020.02 | 0.9 | 0.2 | 4 | 15 | 28 | 53 | 1.11 | |
| CNN-DMTraining Corpus=CNN-DM, Query-biased=false2020.02 | 0.86 | 0.28 | 0 | 1 | 24 | 75 | 1.73 | |
| DMOZTraining Corpus=DMOZ, Query-biased=false2020.02 | 0.81 | 0.17 | 2 | 4 | 43 | 51 | 1.37 | |
| Paraphraserquery-biased=false2020.02 | 0.81 | 0.14 | 4 | 22 | 37 | 37 | 0.81 | |
| AnchorContextquery-biased=false2020.02 | 0.79 | 0.19 | 1 | 14 | 38 | 37 | 0.76 | |
| ParaphraserQuery-biased=false2020.02 | 0.78 | 0.22 | 7 | 17 | 40 | 36 | 0.81 | |
| AnchorContext-QBquery-biased=true2020.02 | 0.75 | 0.16 | 4 | 26 | 32 | 38 | 0.74 | |
| AnchorContext-QBTraining Corpus=AnchorContext, Query-biased=true2020.02 | 0.73 | 0.1 | 3 | 35 | 44 | 18 | 0.39 | |
| DMOZquery-biased=false2020.02 | 0.7 | 0.17 | 14 | 27 | 37 | 22 | 0.26 |