# Legal Contract Revision on ALL Avg

Source: [Legal Contract Revision on ALL Avg](<https://www.sota2.com/research/sota/legal-contract-revision-on-all-avg>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T10:11:51.110Z

Evaluation of model performance on the Legal Contract Revision task, aggregated across all relevant datasets (ALL Avg), measured by CQ, RRR, and TES scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Legal Contract Revision |
| Dataset (including any stated split) | ALL Avg |
| Metric | CQ Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 25 of 25 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [CQ Score](<https://www.sota2.com/research/sota/legal-contract-revision-on-all-avg.md?metric=CQ%20Score>): Higher is better; unit: PERCENT.

- [RRR Score](<https://www.sota2.com/research/sota/legal-contract-revision-on-all-avg.md?metric=RRR%20Score>): Higher is better; unit: PERCENT.

- [TES Score](<https://www.sota2.com/research/sota/legal-contract-revision-on-all-avg.md?metric=TES%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | CQ Score | Result date | Report paper |
| --- | --- | --- | --- |
| RCBSF | 86.87 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RCBSF | 83.67 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RCBSF | 82.64 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RCBSF | 80.23 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RAG | 79.81 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Iteration | 79.76 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RCBSF | 77.3 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Iteration | 77.01 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RAG | 76.84 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RAG | 76.81 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Iteration | 76.78 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| CoT | 75.67 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Iteration | 75.56 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Standard | 73.45 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RAG | 73.23 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| CoT | 72.76 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| RAG | 71.67 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| CoT | 71.03 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Standard | 70.42 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Iteration | 70.31 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| CoT | 69.17 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Standard | 68.67 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| CoT | 67.25 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Standard | 66.92 | Not recorded | 69ddca1e7d0172140ec79aa1 |
| Standard | 65.4 | Not recorded | 69ddca1e7d0172140ec79aa1 |

### RCBSF

CQ Score: 86.87. Result ID: 69de12de47f34ce924c60f5e.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction.

### RCBSF

CQ Score: 83.67. Result ID: 69de12de47f34ce924c60f4a.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction.

### RCBSF

CQ Score: 82.64. Result ID: 69de12de47f34ce924c60f54.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction.

### RCBSF

CQ Score: 80.23. Result ID: 69de12de47f34ce924c60f4f.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction.

### RAG

CQ Score: 79.81. Result ID: 69de12de47f34ce924c60f5c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction.

### Iteration

CQ Score: 79.76. Result ID: 69de12de47f34ce924c60f5d.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction.

### RCBSF

CQ Score: 77.3. Result ID: 69de12de47f34ce924c60f59.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction.

### Iteration

CQ Score: 77.01. Result ID: 69de12de47f34ce924c60f53.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction.

### RAG

CQ Score: 76.84. Result ID: 69de12de47f34ce924c60f48.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction.

### RAG

CQ Score: 76.81. Result ID: 69de12de47f34ce924c60f52.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction.

### Iteration

CQ Score: 76.78. Result ID: 69de12de47f34ce924c60f49.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction.

### CoT

CQ Score: 75.67. Result ID: 69de12de47f34ce924c60f5b.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction.

### Iteration

CQ Score: 75.56. Result ID: 69de12de47f34ce924c60f4e.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction.

### Standard

CQ Score: 73.45. Result ID: 69de12de47f34ce924c60f5a.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Chat"}. This record does not assert independent reproduction.

### RAG

CQ Score: 73.23. Result ID: 69de12de47f34ce924c60f4d.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction.

### CoT

CQ Score: 72.76. Result ID: 69de12de47f34ce924c60f47.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction.

### RAG

CQ Score: 71.67. Result ID: 69de12de47f34ce924c60f57.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b91e209131cea23c26.md>)

[Implementation](<https://github.com/huggingface/transformers/blob/master/examples/rag/>)

Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction.

### CoT

CQ Score: 71.03. Result ID: 69de12de47f34ce924c60f51.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction.

### Standard

CQ Score: 70.42. Result ID: 69de12de47f34ce924c60f46.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Base"}. This record does not assert independent reproduction.

### Iteration

CQ Score: 70.31. Result ID: 69de12de47f34ce924c60f58.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea45fc4.md>)

Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction.

### CoT

CQ Score: 69.17. Result ID: 69de12de47f34ce924c60f4c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction.

### Standard

CQ Score: 68.67. Result ID: 69de12de47f34ce924c60f50.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"LawLLM-7B"}. This record does not assert independent reproduction.

### CoT

CQ Score: 67.25. Result ID: 69de12de47f34ce924c60f56.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e571e209131cea3f27b.md>)

Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction.

### Standard

CQ Score: 66.92. Result ID: 69de12de47f34ce924c60f4b.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction.

### Standard

CQ Score: 65.4. Result ID: 69de12de47f34ce924c60f55.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca1e7d0172140ec79aa1.md>)

Recorded evaluation configuration: {"Backbone":"LexiLaw-6B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
