Fine-grained Event-level Financial Sentiment Analysis on EFSA
71.43F1 ScoreQwen-7B-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-7B-ChatSetting=4-hop CoT2024.04 | 71.43 | |
| Baichuan2-13B-ChatSetting=4-hop CoT2024.04 | 69.52 | |
| Baichuan2-13B-ChatSetting=LoRa fine-tune2024.04 | 67.79 | |
| Qwen-7B-ChatSetting=LoRa fine-tune2024.04 | 67.32 | |
| ChatGLM3-6B-ChatSetting=4-hop CoT2024.04 | 65.19 | |
| GLM-4Setting=3-shot2024.04 | 54.9 | |
| GPT-4Setting=4-hop CoT2024.04 | 53.24 | |
| ChatGLM3-6B-ChatSetting=LoRa fine-tune2024.04 | 53.11 | |
| GLM-4Setting=zero-shot2024.04 | 52.72 | |
| GPT-4Setting=3-shot2024.04 | 49.53 | |
| DISC-FinLLMSetting=LoRa fine-tune2024.04 | 49.16 | |
| GPT-4Setting=zero-shot2024.04 | 45.45 | |
| ChatGPTSetting=3-shot2024.04 | 37.13 | |
| ChatGPTSetting=zero-shot2024.04 | 36.96 | |
| Llama2-Chinese-7B-ChatSetting=LoRa fine-tune2024.04 | 36.71 | |
| DISC-FinLLMSetting=3-shot2024.04 | 27.07 | |
| Llama2-Chinese-7b-ChatSetting=4-hop CoT2024.04 | 23.44 | |
| DISC-FinLLMSetting=zero-shot2024.04 | 22.45 | |
| XuanyuanSetting=3-shot2024.04 | 17.16 | |
| XuanyuanSetting=zero-shot2024.04 | 16.41 |