Summarization on BookSum Average latest (test)
17.47Average ROUGECoA
Evaluation Results
| Method | Links | |
|---|---|---|
| CoABackbone=Claude-3-Opus, Context Window=8k2024.06 | 17.47 | |
| CoABackbone=Claude-3-Sonnet, Context Window=8k2024.06 | 14.96 | |
| VanillaBackbone=Claude-3-Opus, Context Window=200k2024.06 | 14 | |
| CoABackbone=Claude-3-Haiku, Context Window=8k2024.06 | 13.7 | |
| VanillaBackbone=Claude-3-Sonnet, Context Window=200k2024.06 | 12.1 | |
| VanillaBackbone=Claude-3-Haiku, Context Window=200k2024.06 | 12.04 |