Event-level Financial Sentiment Analysis on EFSA
71.43F1 ScoreQwen-7B-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-7B-ChatSetting=4-hop CoT2024.04 | 71.43 | |
| Baichuan2-13B-ChatSetting=4-hop CoT2024.04 | 69.52 | |
| Qwen-7B-ChatSetting=LoRa fine-tune2024.04 | 67.28 | |
| Baichuan2-13B-ChatSetting=LoRa fine-tune2024.04 | 67.06 | |
| ChatGLM3-6B-ChatSetting=4-hop CoT2024.04 | 65.19 | |
| GPT-4Setting=4-hop CoT2024.04 | 53.24 | |
| ChatGLM3-6B-ChatSetting=LoRa fine-tune2024.04 | 51.18 | |
| GLM-4Setting=3-shot2024.04 | 50.68 | |
| GLM-4Setting=zero-shot2024.04 | 49.41 | |
| DISC-FinLLMSetting=LoRa fine-tune2024.04 | 46.98 | |
| GPT-4Setting=3-shot2024.04 | 39.24 | |
| Llama2-Chinese-7B-ChatSetting=LoRa fine-tune2024.04 | 36.28 | |
| GPT-4Setting=zero-shot2024.04 | 36.1 | |
| ChatGPTSetting=3-shot2024.04 | 27.57 | |
| ChatGPTSetting=zero-shot2024.04 | 26.17 | |
| DISC-FinLLMSetting=3-shot2024.04 | 24.68 | |
| Llama2-Chinese-7b-ChatSetting=4-hop CoT2024.04 | 23.44 | |
| DISC-FinLLMSetting=zero-shot2024.04 | 19.25 | |
| XuanyuanSetting=3-shot2024.04 | 12.39 | |
| XuanyuanSetting=zero-shot2024.04 | 7.85 |