Long-text patent generation on PAP2PAT
30.1Tokens (Absolute)Similar Patent
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Similar PatentCategory=Heuristic Baselines / Skylines2024.10 | 30.1 | 166 | 0.658 | 0.337 | — | — | — | 0.753 | 0.983 | 12.3 | 0.1 | |
| COPGEN Llama-3 8BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=2k, Backbone=Llama-3 8B, Training=SFT2024.10 | 27.5 | 151.5 | 0.704 | 0.428 | — | — | — | 0.594 | 0.98 | 53.7 | 29.3 | |
| Reference PatentCategory=Heuristic Baselines / Skylines2024.10 | 18.1 | 100 | 1 | 1 | — | — | — | 1 | 1 | 14.4 | 0.2 | |
| COPGEN Qwen2-72BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=400, Backbone=Qwen2-72B2024.10 | 18.1 | 100 | 0.717 | 0.508 | — | — | — | 0.478 | 0.971 | 10 | 0.5 | |
| COPGEN Llama-3 8BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=2k, Backbone=Llama-3 8B, Training=SFT, Repetition Removal=true2024.10 | 17.3 | 95.4 | 0.712 | 0.496 | — | — | — | 0.647 | 0.985 | 38.4 | 8.5 | |
| COPGEN Llama-3 8BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=2k, Backbone=Llama-3 8B2024.10 | 9.6 | 53.1 | 0.687 | 0.414 | — | — | — | 0.432 | 0.97 | 27 | 4.4 | |
| PaperCategory=Heuristic Baselines / Skylines2024.10 | 8.1 | 44.5 | 0.697 | 0.394 | — | — | — | 0.472 | 0.984 | 8.4 | 0 | |
| COPGEN Qwen2-72BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=2k, Backbone=Qwen2-72B2024.10 | 8.1 | 44.8 | 0.702 | 0.413 | — | — | — | 0.475 | 0.973 | 12.8 | 1.2 | |
| COPGEN Llama-3 70BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=2k, Backbone=Llama-3 70B2024.10 | 6.1 | 33.9 | 0.702 | 0.39 | — | — | — | 0.495 | 0.974 | 17.5 | 0.2 | |
| COPGEN Mixtral-8x7BArchitecture=COPGEN, T_inst=2k, T_pap=3k, T_pat=2k, Backbone=Mixtral-8x7B2024.10 | 5.6 | 31 | 0.691 | 0.355 | — | — | — | 0.493 | 0.975 | 14.5 | 0.4 | |
| Qwen2-72BArchitecture=Single LLM-call, T_inst=2k, T_pap=∞, T_pat=∞, w/o Paper=true2024.10 | 3.5 | 19.3 | 0.661 | 0.232 | — | — | — | 0.371 | 0.966 | 9.8 | 0.6 | |
| Mixtral-8x7BArchitecture=Single LLM-call, T_inst=2k, T_pap=∞, T_pat=∞2024.10 | 3.2 | 17.7 | 0.661 | 0.231 | — | — | — | 0.426 | 0.969 | 17.9 | 0.6 | |
| Qwen2-72BArchitecture=Single LLM-call, T_inst=2k, T_pap=∞, T_pat=∞2024.10 | 2.8 | 15.6 | 0.666 | 0.213 | — | — | — | 0.396 | 0.973 | 9.5 | 0.5 | |
| Qwen2-72BArchitecture=Single LLM-call, T_inst=2k, T_pap=∞, T_pat=∞, w/o Outline=true2024.10 | 2 | 11.1 | 0.642 | 0.169 | — | — | — | 0.398 | 0.974 | 9.3 | 0.1 | |
| OutlineCategory=Heuristic Baselines / Skylines2024.10 | 1.4 | 7.9 | 0.565 | 0.101 | — | — | — | 0.244 | 0.856 | 20.1 | 0.2 |