# Verdict Prediction on AITA 1.0 (author split) Source: [Verdict Prediction on AITA 1.0 (author split)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:31:10.016Z Evaluation of model performance on Verdict Prediction using the author split of the AITA 1.0 dataset, typically measured using Accuracy and F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Verdict Prediction | | Dataset (including any stated split) | AITA 1.0 (author split) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | C1: Financial Issues | 85.6 | Not recorded | 6944dbe0423ea422657298ac | | Attitudes | 85.5 | Not recorded | 6944dbe0423ea422657298ac | | Relationships | 85.5 | Not recorded | 6944dbe0423ea422657298ac | | C4: Family Struct. Change | 85.5 | Not recorded | 6944dbe0423ea422657298ac | | C5: Rel. Issues w/Men | 85.5 | Not recorded | 6944dbe0423ea422657298ac | | C6: Rel. Issues w/Women | 85.5 | Not recorded | 6944dbe0423ea422657298ac | | Demographics | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | Experiences | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | C3: Parenting & Discipline | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | C7: Sympathy & Support | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | C8: Family Disputes | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | C9: Negative Affect | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | C10: Food & Meals | 85.4 | Not recorded | 6944dbe0423ea422657298ac | | C2: Acc. Social Needs | 85.3 | Not recorded | 6944dbe0423ea422657298ac | ### C1: Financial Issues Accuracy: 85.6. Result ID: 6996bb635698665ec4062d93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"30"}. This record does not assert independent reproduction. ### Attitudes Accuracy: 85.5. Result ID: 6996bb635698665ec4062d8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","Annotator Coverage (5+%)":"68"}. This record does not assert independent reproduction. ### Relationships Accuracy: 85.5. Result ID: 6996bb635698665ec4062d92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","Annotator Coverage (5+%)":"56"}. This record does not assert independent reproduction. ### C4: Family Struct. Change Accuracy: 85.5. Result ID: 6996bb635698665ec4062d96. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"33"}. This record does not assert independent reproduction. ### C5: Rel. Issues w/Men Accuracy: 85.5. Result ID: 6996bb635698665ec4062d97. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"37"}. This record does not assert independent reproduction. ### C6: Rel. Issues w/Women Accuracy: 85.5. Result ID: 6996bb635698665ec4062d98. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"42"}. This record does not assert independent reproduction. ### Demographics Accuracy: 85.4. Result ID: 6996bb635698665ec4062d90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","Annotator Coverage (5+%)":"69"}. This record does not assert independent reproduction. ### Experiences Accuracy: 85.4. Result ID: 6996bb635698665ec4062d91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","Annotator Coverage (5+%)":"48"}. This record does not assert independent reproduction. ### C3: Parenting & Discipline Accuracy: 85.4. Result ID: 6996bb635698665ec4062d95. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"33"}. This record does not assert independent reproduction. ### C7: Sympathy & Support Accuracy: 85.4. Result ID: 6996bb635698665ec4062d99. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"24"}. This record does not assert independent reproduction. ### C8: Family Disputes Accuracy: 85.4. Result ID: 6996bb635698665ec4062d9a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"32"}. This record does not assert independent reproduction. ### C9: Negative Affect Accuracy: 85.4. Result ID: 6996bb635698665ec4062d9b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"39"}. This record does not assert independent reproduction. ### C10: Food & Meals Accuracy: 85.4. Result ID: 6996bb635698665ec4062d9c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"23"}. This record does not assert independent reproduction. ### C2: Acc. Social Needs Accuracy: 85.3. Result ID: 6996bb635698665ec4062d94. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","Annotator Coverage (5+%)":"42"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.