# Judgment Prediction on AITA verdict Source: [Judgment Prediction on AITA verdict]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:31:09.996Z Evaluation of model performance on predicting the verdict (e.g., AITA judgment) based on the provided context, measured using Accuracy and F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Judgment Prediction | | Dataset (including any stated split) | AITA verdict | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Attitudes | 85.9 | Not recorded | 6944dbe0423ea422657298ac | | C1: Financial Issues | 85.9 | Not recorded | 6944dbe0423ea422657298ac | | C3: Parenting & Discipline | 85.9 | Not recorded | 6944dbe0423ea422657298ac | | C4: Family Struct. Change | 85.9 | Not recorded | 6944dbe0423ea422657298ac | | C7: Sympathy & Support | 85.9 | Not recorded | 6944dbe0423ea422657298ac | | Demographics | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | Experiences | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | Relationships | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | C2: Acc. Social Needs | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | C5: Rel. Issues w/Men | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | C6: Rel. Issues w/Women | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | C8: Family Disputes | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | C9: Negative Affect | 85.8 | Not recorded | 6944dbe0423ea422657298ac | | C10: Food & Meals | 85.7 | Not recorded | 6944dbe0423ea422657298ac | ### Attitudes Accuracy: 85.9. Result ID: 6996bb635698665ec4062d81. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","5+%":"68"}. This record does not assert independent reproduction. ### C1: Financial Issues Accuracy: 85.9. Result ID: 6996bb635698665ec4062d85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"30"}. This record does not assert independent reproduction. ### C3: Parenting & Discipline Accuracy: 85.9. Result ID: 6996bb635698665ec4062d87. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"33"}. This record does not assert independent reproduction. ### C4: Family Struct. Change Accuracy: 85.9. Result ID: 6996bb635698665ec4062d88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"33"}. This record does not assert independent reproduction. ### C7: Sympathy & Support Accuracy: 85.9. Result ID: 6996bb635698665ec4062d8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"24"}. This record does not assert independent reproduction. ### Demographics Accuracy: 85.8. Result ID: 6996bb635698665ec4062d82. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","5+%":"69"}. This record does not assert independent reproduction. ### Experiences Accuracy: 85.8. Result ID: 6996bb635698665ec4062d83. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","5+%":"48"}. This record does not assert independent reproduction. ### Relationships Accuracy: 85.8. Result ID: 6996bb635698665ec4062d84. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Theory Based High-level Categorization","5+%":"56"}. This record does not assert independent reproduction. ### C2: Acc. Social Needs Accuracy: 85.8. Result ID: 6996bb635698665ec4062d86. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"42"}. This record does not assert independent reproduction. ### C5: Rel. Issues w/Men Accuracy: 85.8. Result ID: 6996bb635698665ec4062d89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"37"}. This record does not assert independent reproduction. ### C6: Rel. Issues w/Women Accuracy: 85.8. Result ID: 6996bb635698665ec4062d8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"42"}. This record does not assert independent reproduction. ### C8: Family Disputes Accuracy: 85.8. Result ID: 6996bb635698665ec4062d8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"32"}. This record does not assert independent reproduction. ### C9: Negative Affect Accuracy: 85.8. Result ID: 6996bb635698665ec4062d8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"39"}. This record does not assert independent reproduction. ### C10: Food & Meals Accuracy: 85.7. Result ID: 6996bb635698665ec4062d8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Categorization Type":"Automatic High-level Categorization","5+%":"23"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.