Language Modeling on Skywork
3.25Finance ScoreFullCPT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FullCPTBackbone=Llama-2 13B, CPT=FullCPT2024.06 | 3.25 | 7.88 | 4.38 | 3.61 | 10.7 | 5.54 | 5.89 | |
| FullCPTBackbone=Llama-2 7B, CPT=FullCPT2024.06 | 3.37 | 8.24 | 4.5 | 3.77 | 11.04 | 5.76 | 6.11 | |
| SATBackbone=Llama-2 13B, CPT=SAT2024.06 | 3.48 | 8.23 | 4.58 | 3.89 | 11.22 | 5.76 | 6.19 | |
| SATBackbone=Llama-2 7B, CPT=SAT2024.06 | 3.69 | 8.78 | 4.8 | 4.14 | 11.86 | 6.07 | 6.56 | |
| SPDFBackbone=Llama-2 13B, CPT=SPDF2024.06 | 3.73 | 8.82 | 4.89 | 4.24 | 12.31 | 6.08 | 6.68 | |
| SPDFBackbone=Llama-2 7B, CPT=SPDF2024.06 | 3.91 | 9.35 | 5.1 | 4.49 | 12.79 | 6.4 | 7.01 | |
| OriginalBackbone=Llama-2 13B, CPT=Original2024.06 | 6 | 11.46 | 7.26 | 7.59 | 17.22 | 8.09 | 9.6 | |
| OriginalBackbone=Llama-2 7B, CPT=Original2024.06 | 6.48 | 12.65 | 7.79 | 8.6 | 18.7 | 8.81 | 10.51 |