Number Understanding on Financial Number Understanding
0.63NUGPT-4 (gpt-4-0613)
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4 (gpt-4-0613)Type=Heart, Zero-shot=true2024.02 | 0.63 | |
| ChatGPT (gpt-3.5-turbo)Type=Heart, Zero-shot=true2024.02 | 0.58 | |
| FinMA-7BType=Club, Zero-shot=true2024.02 | 0.16 | |
| FinTral-DPOType=Spade, Zero-shot=true2024.02 | 0.15 | |
| FinMA-7B-fullType=Spade, Zero-shot=true2024.02 | 0.12 | |
| FinTral-INSTType=Spade, Zero-shot=true2024.02 | 0.02 | |
| FinMA-7B-tradeType=Spade, Zero-shot=true2024.02 | 0 | |
| Llama-2-7b-hfType=Club, Zero-shot=true2024.02 | 0 | |
| Mistral-7B-v0.1Type=Club, Zero-shot=true2024.02 | 0 | |
| Vicuna-7BType=Diamond, Zero-shot=true2024.02 | 0 | |
| Mistral-7B-Instruct-v0.1Type=Diamond, Zero-shot=true2024.02 | 0 | |
| Llama-2-13b-chat-hfType=Heart, Zero-shot=true2024.02 | 0 | |
| Llama-2-7b-chat-hfType=Heart, Zero-shot=true2024.02 | 0 |