Question Answering on ELI5 Wiki-answerable
26.6ROUGE-L ScoreKID
Evaluation Results
| Method | Links | |
|---|---|---|
| KIDAvailable FT Data=100%, Backbone=GPT2-medium2022.04 | 26.6 | |
| RAGAvailable FT Data=100%, Mechanism=Wiki Retrieval Augmented2022.04 | 21.4 | |
| QA-GNNAvailable FT Data=100%, Mechanism=GNN + Attention2022.04 | 19.5 | |
| ReFlectiveAvailable FT Data=100%, Mechanism=Forward + Backward LMs2022.04 | 18.2 | |
| FiD-T5Available FT Data=100%, Mechanism=Two-step Retrieval + Seq2Seq2022.04 | 18.1 | |
| GPT2 + COMeT Emb.Available FT Data=100%, Mechanism=KG Embedding Fuse2022.04 | 17.3 | |
| GPT2 + KnowledgeAvailable FT Data=100%, Mechanism=KG Triplets Post-train2022.04 | 15.7 | |
| KIDAvailable FT Data=10%, Backbone=GPT2-medium2022.04 | 15.2 | |
| GPT2 + COMeT Emb.Available FT Data=10%, Mechanism=KG Embedding Fuse2022.04 | 13.4 | |
| GPT2 + KnowledgeAvailable FT Data=10%, Mechanism=KG Triplets Post-train2022.04 | 9.3 | |
| ReFlectiveAvailable FT Data=10%, Mechanism=Forward + Backward LMs2022.04 | 8.7 | |
| QA-GNNAvailable FT Data=10%, Mechanism=GNN + Attention2022.04 | 6.2 | |
| RAGAvailable FT Data=10%, Mechanism=Wiki Retrieval Augmented2022.04 | 5.7 | |
| FiD-T5Available FT Data=10%, Mechanism=Two-step Retrieval + Seq2Seq2022.04 | 3.9 |