Document Summarization on ScriptBase
0.502R1CachED BARTlarge
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CachED BARTlargeContext Length=128K2025.01 | 0.502 | 0.149 | 0.204 | 0.646 | |
| GPT-4oProtocol=Zero-shot (ZS), Context Length=128K2025.01 | 0.4202 | 0.102 | 0.3894 | 0.5624 | |
| Llama 3.1 8BProtocol=LoRA Fine-Tuning (FT), Context Length=128K2025.01 | 0.2334 | 0.048 | 0.1863 | 0.4698 | |
| Llama 3.1 8BProtocol=Zero-shot (ZS), Context Length=128K2025.01 | 0.1463 | 0.0217 | 0.1368 | 0.4397 |