# Fine-Grained Narrative Classification on INDI-PROP Farmer's Protest 1.0 (test)

Source: [Fine-Grained Narrative Classification on INDI-PROP Farmer's Protest 1.0 (test)](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:52:45.361Z

Evaluation of model performance on the test split of the INDI-PROP Farmer's Protest 1.0 dataset using Fine-Grained Narrative Classification, reporting Micro, Macro, and Weighted Precision, Recall, and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fine-Grained Narrative Classification |
| Dataset (including any stated split) | INDI-PROP Farmer's Protest 1.0 (test) |
| Metric | Micro Precision |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Micro Precision](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Micro%20Precision>): Higher is better; unit: SCALAR.

- [Micro Recall](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Micro%20Recall>): Higher is better; unit: SCALAR.

- [Micro F1 Score](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Micro%20F1%20Score>): Higher is better; unit: SCALAR.

- [Macro Precision](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Macro%20Precision>): Higher is better; unit: SCALAR.

- [Macro Recall](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Macro%20Recall>): Higher is better; unit: SCALAR.

- [Macro F1 Score](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Macro%20F1%20Score>): Higher is better; unit: SCALAR.

- [Weighted Precision](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Weighted%20Precision>): Higher is better; unit: SCALAR.

- [Weighted Recall](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Weighted%20Recall>): Higher is better; unit: SCALAR.

- [Weighted F1 Score](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-farmer-s-protest-1-0-test.md?metric=Weighted%20F1%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Micro Precision | Result date | Report paper |
| --- | --- | --- | --- |
| FANTA | 0.757 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.732 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.73 | Not recorded | 69311574d6b0dd3342933a83 |
| RoBERTa | 0.714 | Not recorded | 69311574d6b0dd3342933a83 |
| BERT | 0.712 | Not recorded | 69311574d6b0dd3342933a83 |
| DeBERTa | 0.681 | Not recorded | 69311574d6b0dd3342933a83 |
| DistillBERT | 0.621 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.37 | Not recorded | 69311574d6b0dd3342933a83 |
| GPT-4o-mini | 0.3 | Not recorded | 69311574d6b0dd3342933a83 |
| GPT-4o-mini | 0.1 | Not recorded | 69311574d6b0dd3342933a83 |

### FANTA

Micro Precision: 0.757. Result ID: 6996cf275698665ec41b3150.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"Mistral"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.732. Result ID: 6996cf275698665ec41b3152.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.73. Result ID: 6996cf275698665ec41b3153.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","mode":"Concise"}. This record does not assert independent reproduction.

### RoBERTa

Micro Precision: 0.714. Result ID: 6996cf275698665ec41b314a.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction.

### BERT

Micro Precision: 0.712. Result ID: 6996cf275698665ec41b314b.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### DeBERTa

Micro Precision: 0.681. Result ID: 6996cf275698665ec41b314d.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aef1e209131cea2b2a6.md>)

[Implementation](<https://github.com/microsoft/DeBERTa111>)

Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction.

### DistillBERT

Micro Precision: 0.621. Result ID: 6996cf275698665ec41b314c.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67221e209131cea14884.md>)

[Implementation](<https://github.com/huggingface/transformers>)

Recorded evaluation configuration: {"Backbone":"DistillBERT"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.37. Result ID: 6996cf275698665ec41b3151.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"Gemma"}. This record does not assert independent reproduction.

### GPT-4o-mini

Micro Precision: 0.3. Result ID: 6996cf275698665ec41b314e.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction.

### GPT-4o-mini

Micro Precision: 0.1. Result ID: 6996cf275698665ec41b314f.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"mode":"Few-Shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.