# Sentiment Analysis on Financial PhraseBank (FPB)

Source: [Sentiment Analysis on Financial PhraseBank (FPB)](<https://www.sota2.com/research/sota/sentiment-analysis-on-financial-phrasebank-fpb>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-05T07:20:37.762Z

Evaluation of Sentiment Analysis performance on the Financial PhraseBank (FPB) dataset, measured using both Accuracy and F-1 score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Sentiment Analysis |
| Dataset (including any stated split) | Financial PhraseBank (FPB) |
| Metric | Macro F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 24 of 24 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Macro F1 Score](<https://www.sota2.com/research/sota/sentiment-analysis-on-financial-phrasebank-fpb.md?metric=Macro%20F1%20Score>): Higher is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/sentiment-analysis-on-financial-phrasebank-fpb.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [F1 Score](<https://www.sota2.com/research/sota/sentiment-analysis-on-financial-phrasebank-fpb.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Macro F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| SC | 88.54 | Not recorded | 68fa78e51e209131cea7b0dd |
| Base LLM | 85.8 | Not recorded | 68fa78e51e209131cea7b0dd |
| SC | 85.58 | Not recorded | 68fa78e51e209131cea7b0dd |
| CC | 84.64 | Not recorded | 68fa78e51e209131cea7b0dd |
| DC | 83.59 | Not recorded | 68fa78e51e209131cea7b0dd |
| BC | 83.59 | Not recorded | 68fa78e51e209131cea7b0dd |
| BC | 82.71 | Not recorded | 68fa78e51e209131cea7b0dd |
| DC | 82.44 | Not recorded | 68fa78e51e209131cea7b0dd |
| CC | 80.97 | Not recorded | 68fa78e51e209131cea7b0dd |
| Base LLM | 80.26 | Not recorded | 68fa78e51e209131cea7b0dd |
| SC | 74.97 | Not recorded | 68fa78e51e209131cea7b0dd |
| BC | 66.87 | Not recorded | 68fa78e51e209131cea7b0dd |
| CC | 35.96 | Not recorded | 68fa78e51e209131cea7b0dd |
| DC | 35.92 | Not recorded | 68fa78e51e209131cea7b0dd |
| Base LLM | 30.13 | Not recorded | 68fa78e51e209131cea7b0dd |

### SC

Macro F1 Score: 88.54. Result ID: 69a92eb86dbb7075b95224ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

Recorded evaluation configuration: {"Model":"Mistral","Shots":"8-shot"}. This record does not assert independent reproduction.

### Base LLM

Macro F1 Score: 85.8. Result ID: 69a92eb86dbb7075b95224c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

Recorded evaluation configuration: {"Model":"Mistral","Shots":"8-shot"}. This record does not assert independent reproduction.

### SC

Macro F1 Score: 85.58. Result ID: 69a92eb86dbb7075b95224c5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

Recorded evaluation configuration: {"Model":"Llama","Shots":"8-shot"}. This record does not assert independent reproduction.

### CC

Macro F1 Score: 84.64. Result ID: 69a92eb86dbb7075b95224c7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a201e209131cea261f0.md>)

Recorded evaluation configuration: {"Model":"Mistral","Shots":"8-shot"}. This record does not assert independent reproduction.

### DC

Macro F1 Score: 83.59. Result ID: 69a92eb86dbb7075b95224c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998c.md>)

[Implementation](<https://github.com/fywalter/label-bias>)

Recorded evaluation configuration: {"Model":"Mistral","Shots":"8-shot"}. This record does not assert independent reproduction.

### BC

Macro F1 Score: 83.59. Result ID: 69a92eb86dbb7075b95224c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75f51e209131cea6aa55.md>)

Recorded evaluation configuration: {"Model":"Mistral","Shots":"8-shot"}. This record does not assert independent reproduction.

### BC

Macro F1 Score: 82.71. Result ID: 69a92eb86dbb7075b95224c4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75f51e209131cea6aa55.md>)

Recorded evaluation configuration: {"Model":"Llama","Shots":"8-shot"}. This record does not assert independent reproduction.

### DC

Macro F1 Score: 82.44. Result ID: 69a92eb86dbb7075b95224c3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998c.md>)

[Implementation](<https://github.com/fywalter/label-bias>)

Recorded evaluation configuration: {"Model":"Llama","Shots":"8-shot"}. This record does not assert independent reproduction.

### CC

Macro F1 Score: 80.97. Result ID: 69a92eb86dbb7075b95224c2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a201e209131cea261f0.md>)

Recorded evaluation configuration: {"Model":"Llama","Shots":"8-shot"}. This record does not assert independent reproduction.

### Base LLM

Macro F1 Score: 80.26. Result ID: 69a92eb86dbb7075b95224c1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

Recorded evaluation configuration: {"Model":"Llama","Shots":"8-shot"}. This record does not assert independent reproduction.

### SC

Macro F1 Score: 74.97. Result ID: 69a92eb86dbb7075b95224c0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

Recorded evaluation configuration: {"Model":"Qwen","Shots":"8-shot"}. This record does not assert independent reproduction.

### BC

Macro F1 Score: 66.87. Result ID: 69a92eb86dbb7075b95224bf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75f51e209131cea6aa55.md>)

Recorded evaluation configuration: {"Model":"Qwen","Shots":"8-shot"}. This record does not assert independent reproduction.

### CC

Macro F1 Score: 35.96. Result ID: 69a92eb86dbb7075b95224bd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a201e209131cea261f0.md>)

Recorded evaluation configuration: {"Model":"Qwen","Shots":"8-shot"}. This record does not assert independent reproduction.

### DC

Macro F1 Score: 35.92. Result ID: 69a92eb86dbb7075b95224be.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70371e209131cea4998c.md>)

[Implementation](<https://github.com/fywalter/label-bias>)

Recorded evaluation configuration: {"Model":"Qwen","Shots":"8-shot"}. This record does not assert independent reproduction.

### Base LLM

Macro F1 Score: 30.13. Result ID: 69a92eb86dbb7075b95224bc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa78e51e209131cea7b0dd.md>)

Recorded evaluation configuration: {"Model":"Qwen","Shots":"8-shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
