Long-context Question Answering on GovReport
68.4C ScoreClaude-3-sonnet
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Claude-3-sonnetCitation Strategy=LAC-S2024.09 | 68.4 | 70.1 | 98 | |
| LongCite-8BCitation Strategy=LAC-S2024.09 | 63 | 54.4 | 116 | |
| Mistral-Large-InstructCitation Strategy=LAC-S2024.09 | 60.4 | 68.3 | 88 | |
| LongCite-9BCitation Strategy=LAC-S2024.09 | 59.6 | 46.4 | 128 | |
| GLM-4Citation Strategy=LAC-S2024.09 | 59.4 | 65.9 | 90 | |
| GLM-4-9B-chatCitation Strategy=LAC-S2024.09 | 59.3 | 61.6 | 96 | |
| Llama-3.1-70B-InstructCitation Strategy=LAC-S2024.09 | 56.3 | 66.9 | 84 | |
| Llama-3.1-8B-InstructCitation Strategy=LAC-S2024.09 | 49.6 | 62.1 | 80 | |
| GPT-4oCitation Strategy=LAC-S2024.09 | 46 | 61.3 | 75 |