Financial Analysis on Diverse Financial Tasks
83SA ScoreFinTral-DPO-T&R
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| FinTral-DPO-T&RType=DPO + Tools + Retrieval2024.02 | 83 | 83 | 60 | 72 | 56 | 62 | 75 | 70 | |
| FinTral-DPOType=DPO2024.02 | 82 | 70 | 15 | 60 | 54 | 62 | 67 | 59 | |
| FinTral-INSTType=Instruction2024.02 | 81 | 40 | 2 | 40 | 53 | 61 | 66 | 49 | |
| GPT-4-Turbo (gpt-4-1106-preview)Type=DPO + Tools + Retrieval2024.02 | 79 | 80 | 83 | 65 | 54 | 70 | 73 | 72 | |
| ChatGPT (gpt-3.5-turbo-1106)Type=DPO2024.02 | 70 | 53 | 58 | 59 | 53 | 31 | 52 | 53 | |
| Llama-2-7b-chat-hfType=DPO + Tools + Retrieval2024.02 | 54 | 7 | 0 | 31 | 52 | 56 | 32 | 33 | |
| Mistral-7B-Instruct-v0.1Type=Standard2024.02 | 49 | 0 | 0 | 30 | 49 | 48 | 29 | 29 |