Patent Quality Evaluation on Pap2Pat EvalGold N=146 (test)
68TCFPat-DEVAL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Pat-DEVALBackbone=Qwen3-32B2026.01 | 68 | 72 | 64 | 73 | 69 | |
| G-EvalBackbone=Qwen3-32B2026.01 | 58 | 54 | 51 | 45 | 52 | |
| Prometheus-2Backbone=Qwen3-32B2026.01 | 51 | 48 | 44 | 39 | 46 | |
| Standard CoTBackbone=Qwen3-32B2026.01 | 45 | 41 | 38 | 32 | 39 | |
| GPTScoreBackbone=Qwen3-32B2026.01 | 38 | 35 | 29 | 22 | 31 | |
| BERTScore2026.01 | 31 | 27 | 18 | 15 | 23 | |
| ROUGE-L2026.01 | 15 | 10 | 7 | 4 | 9 | |
| BLEU2026.01 | 12 | 8 | 5 | 3 | 7 |