# Generating Information-Seeking Conversations from Unlabeled Documents

Source: [Generating Information-Seeking Conversations from Unlabeled Documents](<https://www.sota2.com/research/paper/68fa6dc11e209131cea3be12>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T00:42:13.334Z

Authors: Gangwoo Kim, Sungdong Kim, Kang Min Yoo, Jaewoo Kang

Published: 2022-05-25T09:33:00.000Z

## Abstract

In this paper, we introduce a novel framework, SIMSEEK, (Simulating information-Seeking conversation from unlabeled documents), and compare its two variants. In our baseline SIMSEEK-SYM, a questioner generates follow-up questions upon the predetermined answer by an answerer. On the contrary, SIMSEEK-ASYM first generates the question and then finds its corresponding answer under the conversational context. Our experiments show that they can synthesize effective training resources for CQA and conversational search tasks. As a result, conversations from SIMSEEK-ASYM not only make more improvements in our experiments but also are favorably reviewed in a human evaluation. We finally release a large-scale resource of synthetic conversations, WIKI-SIMSEEK, containing 2 million CQA pairs built upon Wikipedia documents. With the dataset, our CQA model achieves state-of-the-art performance on a recent CQA benchmark, QuAC.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Dialogue Quality Evaluation on SimSeek](<https://www.sota2.com/research/sota/dialogue-quality-evaluation-on-simseek.md>): Dialogue Quality Evaluation; SimSeek; BF1 (qt, at): 0.53.

- [Educational Dialogue Generation on Synthesized Educational Dialogues Human Evaluation](<https://www.sota2.com/research/sota/educational-dialogue-generation-on-synthesized-educational-dialogues-human-evaluation.md>): Educational Dialogue Generation; Synthesized Educational Dialogues Human Evaluation; Answer Relevance: 32.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2205.12609>)

[PDF](<https://arxiv.org/pdf/2205.12609.pdf>)
