Abstractive Summarization on MS MARCO
11.9BLEU ScoreOrca-1-13B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Orca-1-13B2023.11 | 11.9 | 28.47 | 7.68 | |
| Orca-2-13BSystem Message=Direct2023.11 | 9.28 | 23.93 | 7.81 | |
| Orca-2-7BSystem Message=Direct2023.11 | 8.95 | 23.32 | 7.99 | |
| ChatGPT2023.11 | 8.37 | 21.2 | 6.52 | |
| Orca-2-7BSystem Message=Cautious2023.11 | 8.17 | 26.52 | 9.21 | |
| Orca-2-13BSystem Message=Cautious2023.11 | 7.83 | 26.47 | 8.69 | |
| WizardLM-70B2023.11 | 6.46 | 18.64 | 7.58 | |
| LLAMA-2-Chat-70B2023.11 | 5.8 | 16.83 | 7.21 | |
| WizardLM-13B2023.11 | 5.58 | 16.52 | 7.54 | |
| LLAMA-2-Chat-13B2023.11 | 3.71 | 12.77 | 6.28 | |
| GPT-42023.11 | 3.37 | 13.97 | 7.97 |