# Fine-Grained Narrative Classification on INDI-PROP CAA 1.0 (test)

Source: [Fine-Grained Narrative Classification on INDI-PROP CAA 1.0 (test)](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:52:45.342Z

Evaluation of model performance on Fine-Grained Narrative Classification using the test split of the INDI-PROP CAA 1.0 dataset, reporting Micro, Macro, and Weighted Precision, Recall, and F1 scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fine-Grained Narrative Classification |
| Dataset (including any stated split) | INDI-PROP CAA 1.0 (test) |
| Metric | Micro Precision |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Micro Precision](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Micro%20Precision>): Higher is better; unit: SCALAR.

- [Micro Recall](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Micro%20Recall>): Higher is better; unit: SCALAR.

- [Micro F1 Score](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Micro%20F1%20Score>): Higher is better; unit: SCALAR.

- [Macro Precision](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Macro%20Precision>): Higher is better; unit: SCALAR.

- [Macro Recall](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Macro%20Recall>): Higher is better; unit: SCALAR.

- [Macro F1 Score](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Macro%20F1%20Score>): Higher is better; unit: SCALAR.

- [Weighted Precision](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Weighted%20Precision>): Higher is better; unit: SCALAR.

- [Weighted Recall](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Weighted%20Recall>): Higher is better; unit: SCALAR.

- [Weighted F1 Score](<https://www.sota2.com/research/sota/fine-grained-narrative-classification-on-indi-prop-caa-1-0-test.md?metric=Weighted%20F1%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Micro Precision | Result date | Report paper |
| --- | --- | --- | --- |
| RoBERTa | 0.744 | Not recorded | 69311574d6b0dd3342933a83 |
| DeBERTa | 0.68 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.67 | Not recorded | 69311574d6b0dd3342933a83 |
| DistillBERT | 0.664 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.654 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.65 | Not recorded | 69311574d6b0dd3342933a83 |
| BERT | 0.646 | Not recorded | 69311574d6b0dd3342933a83 |
| FANTA | 0.4 | Not recorded | 69311574d6b0dd3342933a83 |
| GPT-4o-mini | 0.34 | Not recorded | 69311574d6b0dd3342933a83 |
| GPT-4o-mini | 0.06 | Not recorded | 69311574d6b0dd3342933a83 |

### RoBERTa

Micro Precision: 0.744. Result ID: 6996cf275698665ec41b3140.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"Backbone":"RoBERTa"}. This record does not assert independent reproduction.

### DeBERTa

Micro Precision: 0.68. Result ID: 6996cf275698665ec41b3143.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aef1e209131cea2b2a6.md>)

[Implementation](<https://github.com/microsoft/DeBERTa111>)

Recorded evaluation configuration: {"Backbone":"DeBERTa"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.67. Result ID: 6996cf275698665ec41b3149.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini","mode":"Concise"}. This record does not assert independent reproduction.

### DistillBERT

Micro Precision: 0.664. Result ID: 6996cf275698665ec41b3142.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67221e209131cea14884.md>)

[Implementation](<https://github.com/huggingface/transformers>)

Recorded evaluation configuration: {"Backbone":"DistillBERT"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.654. Result ID: 6996cf275698665ec41b3148.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o-mini"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.65. Result ID: 6996cf275698665ec41b3146.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"Mistral"}. This record does not assert independent reproduction.

### BERT

Micro Precision: 0.646. Result ID: 6996cf275698665ec41b3141.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: {"Backbone":"BERT"}. This record does not assert independent reproduction.

### FANTA

Micro Precision: 0.4. Result ID: 6996cf275698665ec41b3147.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"Backbone":"Gemma"}. This record does not assert independent reproduction.

### GPT-4o-mini

Micro Precision: 0.34. Result ID: 6996cf275698665ec41b3144.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction.

### GPT-4o-mini

Micro Precision: 0.06. Result ID: 6996cf275698665ec41b3145.

[Reporting paper](<https://www.sota2.com/research/paper/69311574d6b0dd3342933a83.md>)

Recorded evaluation configuration: {"mode":"Few-Shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.