Plain Summarization on BigPatent
44.94ROUGE-1Llama-3.1-8B-Instruct
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Llama-3.1-8B-InstructRevision Stage=Initial Summary2026.04 | 44.94 | 86.68 | 21.13 | 13.36 | 16.45 | 55.28 | 54.73 | |
| GPT-4oRevision Stage=Initial Summary2026.04 | 41.87 | 86.52 | 18.6 | 13.76 | 18.32 | 59.62 | 53.19 | |
| Llama-3.1-8B-InstructRevision Stage=Round 1, Revision Method=NRLB2026.04 | 40.09 | 85.73 | 16.88 | 12.14 | 13.76 | 61.08 | 57.95 | |
| GPT-4oRevision Stage=Round 1, Revision Method=NRLB2026.04 | 37.74 | 85.82 | 12.57 | 12.31 | 14.69 | 70.51 | 69.53 | |
| Llama-3.1-8B-InstructRevision Stage=Round 2, Revision Method=NRLB2026.04 | 36.87 | 85.11 | 14.62 | 11.47 | 12.42 | 62.62 | 58.94 | |
| GPT-4oRevision Stage=Round 2, Revision Method=NRLB2026.04 | 35.4 | 85.44 | 10.27 | 11.7 | 12.84 | 74.44 | 73.49 | |
| Qwen3-8BRevision Stage=Initial Summary2026.04 | 34.21 | 85.55 | 20.88 | 15.1 | 21.52 | 55.86 | 42.87 | |
| Qwen3-8BRevision Stage=Round 1, Revision Method=NRLB2026.04 | 30.55 | 84.89 | 14.48 | 13.32 | 16.29 | 69.34 | 49.87 | |
| Qwen3-8BRevision Stage=Round 2, Revision Method=NRLB2026.04 | 29.18 | 84.5 | 12.38 | 12.74 | 14.71 | 71.56 | 54.58 |