# Threshold-Based Retrieval and Textual Entailment Detection on Legal Bar Exam Questions

Source: [Threshold-Based Retrieval and Textual Entailment Detection on Legal Bar Exam Questions](<https://www.sota2.com/research/paper/68fa65dc1e209131cea0ce3f>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:56:39.296Z

Authors: Sabine Wehnert, Sayed Anisul Hoque, Wolfram Fenske, Gunter Saake

Published: 2019-05-30T23:17:26.000Z

## Abstract

Getting an overview over the legal domain has become challenging, especially in a broad, international context. Legal question answering systems have the potential to alleviate this task by automatically retrieving relevant legal texts for a specific statement and checking whether the meaning of the statement can be inferred from the found documents. We investigate a combination of the BM25 scoring method of Elasticsearch with word embeddings trained on English translations of the German and Japanese civil law. For this, we define criteria which select a dynamic number of relevant documents according to threshold scores. Exploiting two deep learning classifiers and their respective prediction bias with a threshold-based answer inclusion criterion has shown to be beneficial for the textual entailment task, when compared to the baseline.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1905.13350>)

[PDF](<https://arxiv.org/pdf/1905.13350.pdf>)
