Financial Reasoning on Finance
52.45AccuracyMASA
Evaluation results
| Method | Links | |
|---|---|---|
| MASABackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.5220, A=5, B=12025.10 | 52.45 | |
| CoLABackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.6551, A=2, B=32025.10 | 51.32 | |
| LoRAr=8Backbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.2605, A=1, B=12025.10 | 46.79 | |
| LoRAr=16Backbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.5196, A=1, B=12025.10 | 46.79 | |
| DoRAr=16Backbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.5366, A=1, B=12025.10 | 45.66 | |
| HydraLoRABackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.5785, A=1, B=32025.10 | 43.02 | |
| VB-LoRABackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.2613, A=1, B=12025.10 | 42.64 | |
| BSLoRABackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.2247, A=1, B=12025.10 | 41.51 | |
| LLaMA3-8BBackbone=LLaMA3-8B, Zero-shot=true2025.10 | 26.42 | |
| Prompt TuningBackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.00042025.10 | 24.53 | |
| P-TuningBackbone=LLaMA3-8B, Zero-shot=true, Params. (%)=0.02802025.10 | 22.6 |