# Legal Contract Revision on ContractNLI Source: [Legal Contract Revision on ContractNLI]() Collection index: [llms.txt]() Data updated: 2026-04-14T10:11:50.994Z Evaluation of model performance on the Legal Contract Revision task using the ContractNLI dataset, measured by CQ, RRR, and TES scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Legal Contract Revision | | Dataset (including any stated split) | ContractNLI | | Metric | CQ | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [CQ](): Higher is better; unit: PERCENT. - [RRR](): Higher is better; unit: PERCENT. - [TES](): Higher is better; unit: PERCENT. ## Recorded results | Method | CQ | Result date | Report paper | | --- | --- | --- | --- | | RCBSF | 87.03 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RCBSF | 83.89 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RCBSF | 82.66 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RCBSF | 80.76 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RAG | 80.23 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Iteration | 78.89 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Iteration | 78.56 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RCBSF | 78.23 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RAG | 77.12 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RAG | 76.89 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Iteration | 75.89 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Iteration | 75.67 | Not recorded | 69ddca1e7d0172140ec79aa1 | | CoT | 75.45 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RAG | 73.23 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Standard | 73.12 | Not recorded | 69ddca1e7d0172140ec79aa1 | | CoT | 72.45 | Not recorded | 69ddca1e7d0172140ec79aa1 | | RAG | 71.78 | Not recorded | 69ddca1e7d0172140ec79aa1 | | CoT | 71.23 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Standard | 70.12 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Iteration | 69.56 | Not recorded | 69ddca1e7d0172140ec79aa1 | | CoT | 69.45 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Standard | 68.89 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Standard | 67.12 | Not recorded | 69ddca1e7d0172140ec79aa1 | | CoT | 67.11 | Not recorded | 69ddca1e7d0172140ec79aa1 | | Standard | 65.23 | Not recorded | 69ddca1e7d0172140ec79aa1 | ### RCBSF CQ: 87.03. Result ID: 69de12de47f34ce924c60f13. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction. ### RCBSF CQ: 83.89. Result ID: 69de12de47f34ce924c60eff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction. ### RCBSF CQ: 82.66. Result ID: 69de12de47f34ce924c60f09. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction. ### RCBSF CQ: 80.76. Result ID: 69de12de47f34ce924c60f04. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### RAG CQ: 80.23. Result ID: 69de12de47f34ce924c60f11. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction. ### Iteration CQ: 78.89. Result ID: 69de12de47f34ce924c60f12. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction. ### Iteration CQ: 78.56. Result ID: 69de12de47f34ce924c60f08. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction. ### RCBSF CQ: 78.23. Result ID: 69de12de47f34ce924c60f0e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction. ### RAG CQ: 77.12. Result ID: 69de12de47f34ce924c60efd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction. ### RAG CQ: 76.89. Result ID: 69de12de47f34ce924c60f07. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction. ### Iteration CQ: 75.89. Result ID: 69de12de47f34ce924c60efe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction. ### Iteration CQ: 75.67. Result ID: 69de12de47f34ce924c60f03. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### CoT CQ: 75.45. Result ID: 69de12de47f34ce924c60f10. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction. ### RAG CQ: 73.23. Result ID: 69de12de47f34ce924c60f02. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### Standard CQ: 73.12. Result ID: 69de12de47f34ce924c60f0f. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction. ### CoT CQ: 72.45. Result ID: 69de12de47f34ce924c60efc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction. ### RAG CQ: 71.78. Result ID: 69de12de47f34ce924c60f0c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction. ### CoT CQ: 71.23. Result ID: 69de12de47f34ce924c60f06. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction. ### Standard CQ: 70.12. Result ID: 69de12de47f34ce924c60efb. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction. ### Iteration CQ: 69.56. Result ID: 69de12de47f34ce924c60f0d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction. ### CoT CQ: 69.45. Result ID: 69de12de47f34ce924c60f01. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### Standard CQ: 68.89. Result ID: 69de12de47f34ce924c60f05. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction. ### Standard CQ: 67.12. Result ID: 69de12de47f34ce924c60f00. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### CoT CQ: 67.11. Result ID: 69de12de47f34ce924c60f0b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction. ### Standard CQ: 65.23. Result ID: 69de12de47f34ce924c60f0a. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.