Dataset Description Extraction on MMLongBench-Doc
94.9AccuracyBERT-Desc
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BERT-DescTime (ms)=9.39 ↓ 96.5%2026.03 | 94.9 | 80 | 92.4 | 85.8 | |
| LongformerTime (ms)=265.202026.03 | 92.3 | 67.8 | 83.1 | 74.7 | |
| BigBirdTime (ms)=257.982026.03 | 91.9 | 67.9 | 77.4 | 72.3 | |
| BERT-DescContext window=w/o window, Time (ms)=9.462026.03 | 82.8 | 54.4 | 65.4 | 59.4 | |
| Qwen-Plus (API)Time (ms)=1039.752026.03 | 80.9 | 63.6 | 93.3 | 75.7 |