Firm Disclosure on Financial Firm Disclosure
0.73FD ScoreGPT-4 (gpt-4-0613)
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-4 (gpt-4-0613)Type=Heart, Zero-shot=true2024.02 | 0.73 | |
| FinTral-DPOType=Spade, Zero-shot=true2024.02 | 0.67 | |
| FinTral-INSTType=Spade, Zero-shot=true2024.02 | 0.66 | |
| ChatGPT (gpt-3.5-turbo)Type=Heart, Zero-shot=true2024.02 | 0.52 | |
| Llama-2-7b-chat-hfType=Heart, Zero-shot=true2024.02 | 0.32 | |
| Llama-2-13b-chat-hfType=Heart, Zero-shot=true2024.02 | 0.31 | |
| FinMA-7B-fullType=Spade, Zero-shot=true2024.02 | 0.3 | |
| Mistral-7B-Instruct-v0.1Type=Diamond, Zero-shot=true2024.02 | 0.29 | |
| Llama-2-7b-hfType=Club, Zero-shot=true2024.02 | 0.09 | |
| Mistral-7B-v0.1Type=Club, Zero-shot=true2024.02 | 0.09 | |
| FinMA-7B-tradeType=Spade, Zero-shot=true2024.02 | 0 | |
| Vicuna-7BType=Diamond, Zero-shot=true2024.02 | 0 | |
| FinMA-7BType=Club, Zero-shot=true2024.02 | 0 |