Retrieval-style Queries on LinkedIn's Hiring Agent dataset (v1.0 test)
2.28Latency (s)RAG
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RAGModel=GPT-4o mini, k=1, size=5122026.04 | 2.28 | 1 | 0.69 | |
| RAGModel=GPT-4o mini, k=1, size=10242026.04 | 2.33 | 1 | 1.17 | |
| RAGModel=GPT-3.5, k=1, size=5122026.04 | 2.53 | 1 | 0.69 | |
| RAGModel=GPT-4o mini, k=1, size=20482026.04 | 2.71 | 1 | 1.6 | |
| Mem0Model=GPT-4o mini2026.04 | 2.73 | 1 | 0.26 | |
| RAGModel=GPT-3.5, k=1, size=10242026.04 | 2.79 | 1 | 1.17 | |
| RAGModel=GPT-3.5, k=1, size=20482026.04 | 3.06 | 1 | 1.6 | |
| RAGModel=GPT-4o mini, k=3, size=10242026.04 | 3.26 | 1 | 3.1 | |
| RAPTORModel=GPT-3.52026.04 | 3.26 | 1 | 0.6 | |
| RAGModel=GPT-4o mini, k=3, size=20482026.04 | 3.31 | 1 | 4.71 | |
| RAGModel=GPT-3.5, k=3, size=5122026.04 | 3.34 | 1 | 1.75 | |
| RAGModel=GPT-4o mini, k=3, size=5122026.04 | 3.62 | 1 | 1.75 | |
| RAGModel=GPT-3.5, k=3, size=20482026.04 | 3.65 | 1 | 4.77 | |
| RAPTORModel=GPT-4o mini2026.04 | 3.73 | 1 | 0.6 | |
| HLTMModel=GPT-4o mini2026.04 | 4 | 2 | 3.39 | |
| Full-contextModel=GPT-3.52026.04 | 4.09 | 1 | 32.78 | |
| A-MemModel=GPT-3.52026.04 | 4.22 | 1 | 10.25 | |
| Mem0Model=GPT-3.52026.04 | 4.3 | 1 | 0.33 | |
| HLTMModel=GPT-3.52026.04 | 4.54 | 2 | 3.6 | |
| ReadAgentModel=GPT-3.52026.04 | 5.08 | 2 | 12.86 | |
| A-MemModel=GPT-4o mini2026.04 | 5.31 | 1 | 10.58 | |
| HippoRAGModel=GPT-3.52026.04 | 5.79 | 1.7 | 14.04 | |
| Full-contextModel=GPT-4o mini2026.04 | 6.74 | 1 | 32.78 | |
| RAGModel=GPT-3.5, k=3, size=10242026.04 | 7.54 | 1 | 3.09 | |
| ReadAgentModel=GPT-4o mini2026.04 | 8.28 | 2 | 15.49 | |
| HippoRAGModel=GPT-4o mini2026.04 | 8.63 | 1.7 | 15.75 | |
| GraphRAGModel=GPT-4o mini2026.04 | 13.9 | 20.37 | 28.83 | |
| SimpleMemModel=GPT-4o mini2026.04 | 19.8 | 6.04 | 7.08 | |
| SimpleMemModel=GPT-3.52026.04 | 38.13 | 7 | 23.64 |