Patent Retrieval on Sophia-bench ai_feat
91.3InScope @10 (Section)QaECTER
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| QaECTERQuery Representation=ai_feat.2026.04 | 91.3 | 84.2 | 78.1 | 62.7 | 48.7 | 29.7 | |
| patembed-largeQuery Representation=ai_feat.2026.04 | 91.1 | 84.8 | 77.6 | 63.3 | 47.4 | 29.6 | |
| Octen-Embed-8BQuery Representation=ai_feat.2026.04 | 90.1 | 81.5 | 75.8 | 59 | 46.8 | 27.8 | |
| Octen-Embed-4BQuery Representation=ai_feat.2026.04 | 90.1 | 82.2 | 75.9 | 59.9 | 46.7 | 28.2 | |
| PaECTERQuery Representation=ai_feat.2026.04 | 89.9 | 82.3 | 75.1 | 59.2 | 45.5 | 27.4 | |
| modernbert-embed-baseQuery Representation=ai_feat.2026.04 | 88.5 | 81.1 | 72 | 56.6 | 41.4 | 24.6 | |
| bert-for-patentsQuery Representation=ai_feat.2026.04 | 82.4 | 75 | 59.9 | 46.2 | 30.3 | 18.7 |