# Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents

Source: [Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents](<https://www.sota2.com/research/paper/68fa69e61e209131cea24b8a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:10:38.141Z

Authors: Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, Maosong Sun

Published: 2021-05-09T09:39:25.000Z

## Abstract

Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of artificial intelligence, especially natural language processing (NLP). Recently, inspired by the success of pre-trained language models (PLMs) in the generic domain, many LegalAI researchers devote their effort to apply PLMs to legal tasks. However, utilizing PLMs to address legal tasks is still challenging, as the legal documents usually consist of thousands of tokens, which is far longer than the length that mainstream PLMs can process. In this paper, we release the Longformer-based pre-trained language model, named as Lawformer, for Chinese legal long documents understanding. We evaluate Lawformer on a variety of LegalAI tasks, including judgment prediction, similar case retrieval, legal reading comprehension, and legal question answering. The experimental results demonstrate that our model can achieve promising improvement on tasks with long documents as inputs.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Legal Case Retrieval on LeCaRD v2](<https://www.sota2.com/research/sota/legal-case-retrieval-on-lecard-v2.md>): Legal Case Retrieval; LeCaRD v2; MAP: 70.44.

- [Legal Case Retrieval on LeCaRD](<https://www.sota2.com/research/sota/legal-case-retrieval-on-lecard.md>): Legal Case Retrieval; LeCaRD; MAP: 54.58.

- [Statute Retrieval on STARD (test)](<https://www.sota2.com/research/sota/statute-retrieval-on-stard-test.md>): Statute Retrieval; STARD (test); Recall@10: 29.89.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2105.03887>)

[PDF](<https://arxiv.org/pdf/2105.03887.pdf>)
