Long-context Question Answering on Longbench Chat
73.8Score CClaude-3-sonnet
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Claude-3-sonnetCitation Strategy=LAC-S2024.09 | 73.8 | 77.8 | 95 | |
| GLM-4Citation Strategy=LAC-S2024.09 | 69.4 | 79.8 | 87 | |
| LongCite-8BCitation Strategy=LAC-S2024.09 | 69 | 68.6 | 101 | |
| LongCite-9BCitation Strategy=LAC-S2024.09 | 67.6 | 64.6 | 105 | |
| Mistral-Large-InstructCitation Strategy=LAC-S2024.09 | 63.8 | 67.8 | 94 | |
| GPT-4oCitation Strategy=LAC-S2024.09 | 61.6 | 77.4 | 80 | |
| Llama-3.1-70B-InstructCitation Strategy=LAC-S2024.09 | 60.8 | 64.6 | 94 | |
| GLM-4-9B-chatCitation Strategy=LAC-S2024.09 | 60.4 | 67.8 | 89 | |
| Llama-3.1-8B-InstructCitation Strategy=LAC-S2024.09 | 53.2 | 61.6 | 86 |