Survey Generation on 20 Computer Science topics 64k tokens
73.59SpeedAutoSurvey
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| AutoSurveyWriter=Claude-haiku2024.06 | 73.59 | 0.8225 | 0.7741 | 4.73 | 4.33 | 4.86 | 4.62 | |
| Naive RAG-based LLM generationWriter=Claude-haiku2024.06 | 12.56 | 0.6879 | 0.6197 | 4.4 | 3.66 | 4.66 | 4.19 | |
| Human writing2024.06 | 0.07 | 0.8633 | 0.7778 | 5 | 4.66 | 5 | 4.88 |