Arabic Financial Sentiment Classification on Arabic Financial Sentiment Gold Standard (250 Samples)
61.6AccuracyDeepSeek R1 (Chat)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeepSeek R1 (Chat)2026.05 | 61.6 | 47.3 | 61.6 | 53.4 | 36 | |
| GPT-52026.05 | 57.2 | 60.2 | 57.2 | 58.3 | 82.9 | |
| DeepSeek R1 (Reasoner)2026.05 | 56.8 | 57.1 | 56.8 | 55.6 | 73.9 | |
| GPT-4o Miniused to construct gold standard=true2026.05 | 49.6 | 63.4 | 49.6 | 55.6 | 0 | |
| GPT-4 Turboused to construct gold standard=true2026.05 | 49.6 | 63.4 | 49.6 | 55.6 | 0 | |
| Gemini 2.5 Flashused to construct gold standard=true2026.05 | 49.6 | 63.4 | 49.6 | 55.6 | 0 |