Summary-style Queries on LinkedIn's Hiring Agent Summary-style queries v1.0 (test)
2.33Latency (s)RAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RAGModel=GPT-3.5, k=1, size=5122026.04 | 2.33 | 1 | 0.6 | |
| Mem0Model=GPT-3.52026.04 | 2.61 | 1 | 0.25 | |
| RAGModel=GPT-4o mini, k=3, size=5122026.04 | 2.63 | 1 | 1.53 | |
| RAGModel=GPT-4o mini, k=1, size=10242026.04 | 2.65 | 1 | 0.97 | |
| RAGModel=GPT-4o mini, k=1, size=20482026.04 | 2.71 | 1 | 1.67 | |
| RAPTORModel=GPT-3.52026.04 | 2.71 | 1 | 0.45 | |
| RAGModel=GPT-3.5, k=1, size=10242026.04 | 2.75 | 1 | 1.02 | |
| RAPTORModel=GPT-4o mini2026.04 | 2.76 | 1 | 0.45 | |
| RAGModel=GPT-3.5, k=1, size=20482026.04 | 2.83 | 1 | 1.62 | |
| Mem0Model=GPT-4o mini2026.04 | 2.84 | 1 | 0.19 | |
| RAGModel=GPT-4o mini, k=3, size=10242026.04 | 2.86 | 1 | 2.8 | |
| RAGModel=GPT-4o mini, k=1, size=5122026.04 | 2.92 | 1 | 0.55 | |
| RAGModel=GPT-4o mini, k=3, size=20482026.04 | 3.03 | 1 | 4.67 | |
| RAGModel=GPT-3.5, k=3, size=10242026.04 | 3.05 | 1 | 2.92 | |
| RAGModel=GPT-3.5, k=3, size=5122026.04 | 3.23 | 1 | 1.66 | |
| HLTMModel=GPT-4o mini2026.04 | 3.36 | 2 | 3.24 | |
| A-MemModel=GPT-4o mini2026.04 | 3.4 | 1 | 11.82 | |
| A-MemModel=GPT-3.52026.04 | 3.54 | 1 | 11.85 | |
| HLTMModel=GPT-3.52026.04 | 3.72 | 2 | 3.68 | |
| RAGModel=GPT-3.5, k=3, size=20482026.04 | 3.78 | 1 | 4.67 | |
| Full-contextModel=GPT-3.52026.04 | 3.79 | 1 | 33.85 | |
| HippoRAGModel=GPT-3.52026.04 | 4.56 | 1.94 | 15.02 | |
| ReadAgentModel=GPT-3.52026.04 | 4.84 | 2 | 9.33 | |
| HippoRAGModel=GPT-4o mini2026.04 | 5.02 | 1.94 | 17.04 | |
| ReadAgentModel=GPT-4o mini2026.04 | 5.5 | 2 | 13.31 | |
| Full-contextModel=GPT-4o mini2026.04 | 5.83 | 1 | 33.85 | |
| SimpleMemModel=GPT-4o mini2026.04 | 16.81 | 6.11 | 6.59 | |
| GraphRAGModel=GPT-4o mini2026.04 | 20.91 | 21.99 | 34.18 | |
| SimpleMemModel=GPT-3.52026.04 | 35.58 | 7 | 17.18 |