# SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums

Source: [SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums](<https://www.sota2.com/research/paper/68fa65d81e209131cea0caed>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T05:58:47.394Z

Authors: Tsvetomila Mihaylova, Georgi Karadjov, Pepa Atanasova, Ramy Baly, Mitra Mohtarami, Preslav Nakov (5) \_\_INSTITUTION\_6\_\_ Instituto de Telecomunica\\c{c}\\~oes, Lisbon, Portugal, (2) SiteGround Hosting EOOD, Bulgaria, (3) University of Copenhagen, Denmark, (4) MIT Computer Science, Artificial Intelligence Laboratory, Cambridge, MA, (5) Qatar Computing Research Institute, HBKU)

Published: 2019-05-25T16:46:49.000Z

## Abstract

We present SemEval-2019 Task 8 on Fact Checking in Community Question Answering Forums, which features two subtasks. Subtask A is about deciding whether a question asks for factual information vs. an opinion/advice vs. just socializing. Subtask B asks to predict whether an answer to a factual question is true, false or not a proper answer. We received 17 official submissions for subtask A and 11 official submissions for Subtask B. For subtask A, all systems improved over the majority class baseline. For Subtask B, all systems were below a majority class baseline, but several systems were very close to it. The leaderboard and the data from the competition can be found at http://competitions.codalab.org/competitions/20022

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1906.01727>)

[PDF](<https://arxiv.org/pdf/1906.01727.pdf>)