List your company

Sentiment Analysis on Financial PhraseBank (FPB)

88.54Macro F1 ScoreSC
27.793643.564359.33575.1057May 22, 2025

Evaluation results

MethodLinks
SCModel=Mistral, Shots=8-shot2025.0588.54——
Base LLMModel=Mistral, Shots=8-shot2025.0585.8——
SCModel=Llama, Shots=8-shot2025.0585.58——
CCModel=Mistral, Shots=8-shot2025.0584.64——
DCModel=Mistral, Shots=8-shot2025.0583.59——
BCModel=Mistral, Shots=8-shot2025.0583.59——
BCModel=Llama, Shots=8-shot2025.0582.71——
DCModel=Llama, Shots=8-shot2025.0582.44——
CCModel=Llama, Shots=8-shot2025.0580.97——
Base LLMModel=Llama, Shots=8-shot2025.0580.26——
SCModel=Qwen, Shots=8-shot2025.0574.97——
BCModel=Qwen, Shots=8-shot2025.0566.87——
CCModel=Qwen, Shots=8-shot2025.0535.96——
DCModel=Qwen, Shots=8-shot2025.0535.92——
Base LLMModel=Qwen, Shots=8-shot2025.0530.13——
BERT2023.10—83.381.73
FiLM# Tokens (Financial Corpus)=2.4B2023.10—86.2584.48
FiLM (5.5B)# Tokens (Financial Corpus)=5.5B2023.10—86.1484.11
FinBERT-A# Tokens (Financial Corpus)=237M2023.10—85.2582.45
FinBERT-Y# Tokens (Financial Corpus)=4.9B2023.10—83.6882.52
FLANG-BERT# Tokens (Financial Corpus)=NA2023.10—84.7683.12
FLANG-ROBERTa# Tokens (Financial Corpus)=NA2023.10—83.8682.19
ROBERTa2023.10—85.383.93
SEC-BERT# Tokens (Financial Corpus)=3.1B2023.10—84.3782.18