Stock Trading on BTC (test)
0.4551Compound Return (CR)FLAG-TRADER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FLAG-TRADERBackbone=SmolLM2-135M-Instruct2025.02 | 0.4551 | 1.734 | 0.309 | 0.2444 | |
| GPT-o1-previewModel Category=Proprietary Models2025.02 | 0.3406 | 1.114 | 0.3585 | 0.1708 | |
| DeepSeek-67B-ChatModel Category=Open-Source Models2025.02 | 0.2831 | 0.891 | 0.3722 | 0.1794 | |
| GPT-4Model Category=Proprietary Models2025.02 | 0.224 | 0.828 | 0.317 | 0.1721 | |
| Buy & HoldModel Category=Baseline2025.02 | 0.2182 | 0.683 | 0.3743 | 0.208 | |
| Llama-3.1-8B-InstructModel Category=Open-Source Models2025.02 | 0.2052 | 0.646 | 0.3724 | 0.211 | |
| Llama-3.1-70B-InstructModel Category=Open-Source Models2025.02 | 0.2044 | 0.758 | 0.316 | 0.1781 | |
| Qwen-2.5-Instruct-7BModel Category=Open-Source Models2025.02 | 0.1948 | 0.612 | 0.3729 | 0.208 | |
| GPT-4oModel Category=Proprietary Models2025.02 | 0.1433 | 0.532 | 0.313 | 0.1728 | |
| Yi-1.5-34B-ChatModel Category=Open-Source Models2025.02 | 0.1362 | 0.434 | 0.3678 | 0.2279 | |
| Qwen2.5-32B-InstructModel Category=Open-Source Models2025.02 | 0.1157 | 0.869 | 0.1561 | 0.0798 | |
| Yi-1.5-9B-ChatModel Category=Open-Source Models2025.02 | 0.0795 | 0.253 | 0.368 | 0.2655 | |
| DeepSeek-V2-Lite (15.7B)Model Category=Open-Source Models2025.02 | 0.048 | 0.153 | 0.3685 | 0.2056 | |
| Qwen2.5-72B-InstructModel Category=Open-Source Models2025.02 | 0.0055 | 0.325 | 0.0198 | 0.009 | |
| Palmyra-Fin-70BModel Category=Financial Domain Models2025.02 | -0.2081 | -1.212 | 0.2004 | 0.2778 |