Long-context Retrieval on NIH
100Multi-needle Avg RecallGPT-4
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-42024.07 | 100 | |
| GPT-4o2024.07 | 100 | |
| Llama 3 8B2024.07 | 98.8 | |
| Llama 3 405B2024.07 | 98.1 | |
| Llama 3 70B2024.07 | 97.5 | |
| Claude 3.5 Sonnet2024.07 | 90.8 |
Loading the SOTA2 catalog…