Ripple Effect Prediction on CAPM residuals various LLMs
5.231ANOVA F-StatisticFinRipple
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FinRippleBackbone=vicuna-13b-chat2025.05 | 5.231 | 0.003 | 0.287 | |
| FinRippleBackbone=Phi-3.5-mini-instruct2025.05 | 4.315 | 0.009 | 0.215 | |
| FinRippleBackbone=llama3-8b-instruct2025.05 | 4.11 | 0.01 | 0.203 | |
| FinRippleBackbone=llama2-13b-chat2025.05 | 4.103 | 0.012 | 0.198 | |
| FinRippleBackbone=gemma-2-9b-it2025.05 | 4.012 | 0.014 | 0.159 | |
| FinRipple/w-o alignmentBackbone=vicuna-7b-chat2025.05 | 3.932 | 0.074 | 0.097 | |
| FinRippleBackbone=vicuna-7b-chat2025.05 | 3.832 | 0.019 | 0.341 | |
| FinRipple/w-o alignmentBackbone=gemma-2-9b-it2025.05 | 3.123 | 0.039 | 0.108 | |
| FinRipple/w-o alignmentBackbone=Phi-3.5-mini-instruct2025.05 | 3.122 | 0.048 | 0.11 | |
| FinRippleBackbone=llama2-7b-chat2025.05 | 3.052 | 0.033 | 0.142 | |
| FinRipple/w-o alignmentBackbone=vicuna-13b-chat2025.05 | 3.014 | 0.031 | 0.119 | |
| ICLBackbone=vicuna-13b-chat2025.05 | 3.001 | 0.062 | 0.118 | |
| Zero-ShotBackbone=vicuna-13b-chat2025.05 | 2.91 | 0.058 | 0.11 | |
| Zero-ShotBackbone=GPT 4o-mini2025.05 | 2.875 | 0.145 | 0.1 | |
| FinRipple/w-o alignmentBackbone=llama2-13b-chat2025.05 | 2.835 | 0.051 | 0.105 | |
| ICLBackbone=Phi-3.5-mini-instruct2025.05 | 2.815 | 0.089 | 0.095 | |
| ICLBackbone=vicuna-7b-chat2025.05 | 2.731 | 0.052 | 0.125 | |
| RAGBackbone=vicuna-13b-chat2025.05 | 2.703 | 0.112 | 0.115 | |
| FinRipple/w-o alignmentBackbone=llama3-8b-instruct2025.05 | 2.672 | 0.069 | 0.101 | |
| ICLBackbone=llama2-13b-chat2025.05 | 2.634 | 0.088 | 0.112 | |
| FinRipple/w-o alignmentBackbone=llama2-7b-chat2025.05 | 2.565 | 0.075 | 0.117 | |
| ICLBackbone=llama3-8b-instruct2025.05 | 2.452 | 0.06 | 0.115 | |
| ICLBackbone=gemma-2-9b-it2025.05 | 2.447 | 0.082 | 0.092 | |
| RAGBackbone=gemma-2-9b-it2025.05 | 2.443 | 0.128 | 0.109 | |
| ICLBackbone=llama2-7b-chat2025.05 | 2.392 | 0.097 | 0.108 | |
| ICLBackbone=GPT 4o-mini2025.05 | 2.372 | 0.098 | 0.117 | |
| Zero-ShotBackbone=Phi-3.5-mini-instruct2025.05 | 2.334 | 0.126 | 0.104 | |
| Zero-ShotBackbone=llama3-8b-instruct2025.05 | 2.221 | 0.141 | 0.099 | |
| RAGBackbone=llama2-13b-chat2025.05 | 2.175 | 0.139 | 0.102 | |
| RAGBackbone=GPT 4o-mini2025.05 | 2.153 | 0.144 | 0.099 | |
| ICLBackbone=GPT 3.52025.05 | 2.087 | 0.129 | 0.105 | |
| Zero-ShotBackbone=gemma-2-9b-it2025.05 | 1.905 | 0.172 | 0.091 | |
| Zero-ShotBackbone=llama2-13b-chat2025.05 | 1.782 | 0.188 | 0.082 | |
| Zero-ShotBackbone=GPT 3.52025.05 | 1.645 | 0.223 | 0.088 | |
| RAGBackbone=llama2-7b-chat2025.05 | 1.624 | 0.231 | 0.089 | |
| RAGBackbone=Phi-3.5-mini-instruct2025.05 | 1.563 | 0.257 | 0.097 | |
| Zero-ShotBackbone=vicuna-7b-chat2025.05 | 1.512 | 0.248 | 0.074 | |
| RAGBackbone=GPT 3.52025.05 | 1.375 | 0.301 | 0.09 | |
| Zero-ShotBackbone=llama2-7b-chat2025.05 | 1.304 | 0.274 | 0.068 | |
| RAGBackbone=llama3-8b-instruct2025.05 | 1.21 | 0.324 | 0.085 | |
| RAGBackbone=vicuna-7b-chat2025.05 | 0.91 | 0.452 | 0.071 |