Device-Patent Linking on 585 expert-verified device-patent pairs 1.0 (balanced evaluation set)
60.1Recall@GoldGPT-4-turbo
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4-turboMethod Type=Commercial, Zero-shot=true2026.06 | 60.1 | 28.6 | |
| GPT-4Method Type=Commercial, Zero-shot=true2026.06 | 52.4 | 27.1 | |
| Gemini-2.5-ProMethod Type=Commercial, Zero-shot=true2026.06 | 50.2 | 10.1 | |
| Claude-3.5-SonnetMethod Type=Commercial, Zero-shot=true2026.06 | 29.6 | 11 | |
| DeepSeek-V3Method Type=Open Source, Zero-shot=true2026.06 | 23.5 | 9.5 |