# GPTs and Language Barrier: A Cross-Lingual Legal QA Examination

Source: [GPTs and Language Barrier: A Cross-Lingual Legal QA Examination](<https://www.sota2.com/research/paper/68fa72b61e209131cea58173>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:32:50.348Z

Authors: Ha-Thanh Nguyen, Hiroaki Yamada, Ken Satoh

Published: 2024-03-26T20:47:32.000Z

## Abstract

In this paper, we explore the application of Generative Pre-trained Transformers (GPTs) in cross-lingual legal Question-Answering (QA) systems using the COLIEE Task 4 dataset. In the COLIEE Task 4, given a statement and a set of related legal articles that serve as context, the objective is to determine whether the statement is legally valid, i.e., if it can be inferred from the provided contextual articles or not, which is also known as an entailment task. By benchmarking four different combinations of English and Japanese prompts and data, we provide valuable insights into GPTs' performance in multilingual legal QA scenarios, contributing to the development of more efficient and accurate cross-lingual QA solutions in the legal domain.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2403.18098>)

[PDF](<https://arxiv.org/pdf/2403.18098.pdf>)
