Summarization on BookSum No Trun. latest (test)
17.74Average ROUGECoA
Evaluation results
| Method | Links | |
|---|---|---|
| CoABackbone=Claude-3-Opus, Context Window=8k2024.06 | 17.74 | |
| CoABackbone=Claude-3-Sonnet, Context Window=8k2024.06 | 14.92 | |
| VanillaBackbone=Claude-3-Opus, Context Window=200k2024.06 | 14.11 | |
| CoABackbone=Claude-3-Haiku, Context Window=8k2024.06 | 13.28 | |
| VanillaBackbone=Claude-3-Sonnet, Context Window=200k2024.06 | 12.17 | |
| VanillaBackbone=Claude-3-Haiku, Context Window=200k2024.06 | 11.98 |