Entity Linking (RCM) on CTIConnect 691-pair subset
100F1 ScoreQwen-3-235B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen-3-235BRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 100 | |
| GPT-5Retrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 99 | |
| Claude-Sonnet-4Retrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 99 | |
| LLaMA-3-405BRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 98 | |
| GPT-4oRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 98 | |
| Gemini-2.5-ProRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 96 | |
| Gemini-2.5-FlashRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 96 | |
| Phi-4Retrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 95 | |
| Claude-3.5-HaikuRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 95 | |
| LLaMA-3-8BRetrieval Configuration=Extract-then-Retrieve (EtR)2025.10 | 91 | |
| GPT-5Retrieval Configuration=Vanilla RAG (VR)2025.10 | 75 | |
| Qwen-3-235BRetrieval Configuration=Vanilla RAG (VR)2025.10 | 73 | |
| Claude-Sonnet-4Retrieval Configuration=Vanilla RAG (VR)2025.10 | 72 | |
| GPT-4oRetrieval Configuration=Vanilla RAG (VR)2025.10 | 69 | |
| LLaMA-3-405BRetrieval Configuration=Vanilla RAG (VR)2025.10 | 68 | |
| Gemini-2.5-ProRetrieval Configuration=Vanilla RAG (VR)2025.10 | 65 | |
| Gemini-2.5-FlashRetrieval Configuration=Vanilla RAG (VR)2025.10 | 64 | |
| Phi-4Retrieval Configuration=Vanilla RAG (VR)2025.10 | 63 | |
| Claude-3.5-HaikuRetrieval Configuration=Vanilla RAG (VR)2025.10 | 61 | |
| LLaMA-3-8BRetrieval Configuration=Vanilla RAG (VR)2025.10 | 56 | |
| Claude-Sonnet-4Retrieval Configuration=Closed-Book (CB)2025.10 | 26 | |
| GPT-5Retrieval Configuration=Closed-Book (CB)2025.10 | 15 | |
| LLaMA-3-405BRetrieval Configuration=Closed-Book (CB)2025.10 | 14 | |
| Qwen-3-235BRetrieval Configuration=Closed-Book (CB)2025.10 | 10 | |
| Claude-3.5-HaikuRetrieval Configuration=Closed-Book (CB)2025.10 | 9 | |
| GPT-4oRetrieval Configuration=Closed-Book (CB)2025.10 | 8 | |
| Phi-4Retrieval Configuration=Closed-Book (CB)2025.10 | 7 | |
| Gemini-2.5-ProRetrieval Configuration=Closed-Book (CB)2025.10 | 6 | |
| LLaMA-3-8BRetrieval Configuration=Closed-Book (CB)2025.10 | 5 | |
| Gemini-2.5-FlashRetrieval Configuration=Closed-Book (CB)2025.10 | 4 |