LLM Downstream Evaluation on Regular Benchmarks
62.8CSRDD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DDStep Time (ms)=244, Data Prep. Cost=$, Curriculum=Grow-P2 with 8 cycles2024.05 | 62.8 | 65.2 | 45.3 | 44.2 | 54.4 | |
| Baseline-8kStep Time (ms)=304, Data Prep. Cost=$, Document Masking=false2024.05 | 60.6 | 62.5 | 41.5 | 41.3 | 51.5 | |
| ICLMStep Time (ms)=304, Data Prep. Cost=$$$2024.05 | 60.6 | 62.1 | 44.7 | 40 | 51.7 | |
| Pack-8k+DMStep Time (ms)=304, Data Prep. Cost=$$, Document Masking=true2024.05 | 60.3 | 64 | 44.6 | 41.8 | 52.7 | |
| Baseline-8k+DMStep Time (ms)=304, Data Prep. Cost=$, Document Masking=true2024.05 | 60.2 | 64.1 | 42.8 | 41.8 | 52.4 |