Coarse-grained Event-level Financial Sentiment Analysis on EFSA
76.03F1 ScoreQwen-7B-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-7B-ChatSetting=4-hop CoT2024.04 | 76.03 | |
| Baichuan2-13B-ChatSetting=4-hop CoT2024.04 | 75.66 | |
| Qwen-7B-ChatSetting=LoRa fine-tune2024.04 | 73.22 | |
| Baichuan2-13B-ChatSetting=LoRa fine-tune2024.04 | 71.82 | |
| ChatGLM3-6B-ChatSetting=4-hop CoT2024.04 | 70.61 | |
| ChatGLM3-6B-ChatSetting=LoRa fine-tune2024.04 | 62.26 | |
| GLM-4Setting=zero-shot2024.04 | 57.31 | |
| GLM-4Setting=3-shot2024.04 | 56.97 | |
| DISC-FinLLMSetting=LoRa fine-tune2024.04 | 56.08 | |
| GPT-4Setting=4-hop CoT2024.04 | 55.64 | |
| Llama2-Chinese-7b-ChatSetting=4-hop CoT2024.04 | 51.62 | |
| GPT-4Setting=3-shot2024.04 | 51.43 | |
| GPT-4Setting=zero-shot2024.04 | 48.48 | |
| Llama2-Chinese-7B-ChatSetting=LoRa fine-tune2024.04 | 43.84 | |
| ChatGPTSetting=3-shot2024.04 | 39.24 | |
| DISC-FinLLMSetting=3-shot2024.04 | 38.67 | |
| ChatGPTSetting=zero-shot2024.04 | 37.92 | |
| DISC-FinLLMSetting=zero-shot2024.04 | 32.43 | |
| XuanyuanSetting=3-shot2024.04 | 26.7 | |
| XuanyuanSetting=zero-shot2024.04 | 22.39 |