Text Summarization on Financial Text Summarization
0.65TSGPT-4 (gpt-4-0613)
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4 (gpt-4-0613)Type=Heart, Zero-shot=true2024.02 | 0.65 | |
| FinTral-DPOType=Spade, Zero-shot=true2024.02 | 0.6 | |
| ChatGPT (gpt-3.5-turbo)Type=Heart, Zero-shot=true2024.02 | 0.59 | |
| FinTral-INSTType=Spade, Zero-shot=true2024.02 | 0.4 | |
| FinMA-7B-fullType=Spade, Zero-shot=true2024.02 | 0.35 | |
| Llama-2-7b-chat-hfType=Heart, Zero-shot=true2024.02 | 0.31 | |
| Mistral-7B-Instruct-v0.1Type=Diamond, Zero-shot=true2024.02 | 0.3 | |
| Llama-2-13b-chat-hfType=Heart, Zero-shot=true2024.02 | 0.3 | |
| FinMA-7BType=Club, Zero-shot=true2024.02 | 0.29 | |
| Vicuna-7BType=Diamond, Zero-shot=true2024.02 | 0.2 | |
| FinMA-7B-tradeType=Spade, Zero-shot=true2024.02 | 0.08 | |
| Mistral-7B-v0.1Type=Club, Zero-shot=true2024.02 | 0.05 | |
| Llama-2-7b-hfType=Club, Zero-shot=true2024.02 | 0 |