Patent Retrieval on Sophia-bench (tacd)
91.5InScope @10 (Section)QaECTER
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| QaECTERQuery Representation=tacd2026.04 | 91.5 | 84.4 | 78.4 | 62.8 | 49 | 29.7 | |
| patembed-largeQuery Representation=tacd2026.04 | 91.4 | 85.1 | 78.1 | 63.6 | 48.4 | 29.9 | |
| Octen-Embed-4BQuery Representation=tacd2026.04 | 90.4 | 82.8 | 76.5 | 60.6 | 47.4 | 28.7 | |
| PaECTERQuery Representation=tacd2026.04 | 90.2 | 82.6 | 76 | 59.7 | 46.5 | 27.7 | |
| Octen-Embed-8BQuery Representation=tacd2026.04 | 90.1 | 81.8 | 76.2 | 59.2 | 47.2 | 27.9 | |
| modernbert-embed-baseQuery Representation=tacd2026.04 | 88.9 | 81.3 | 73 | 56.7 | 43 | 25 | |
| bert-for-patentsQuery Representation=tacd2026.04 | 83.4 | 74.4 | 61.4 | 45.4 | 33 | 18.7 |