# Eating Disorder Detection on JiraiBench 1.0 (test) Source: [Eating Disorder Detection on JiraiBench 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:51:27.800Z Evaluation of models for detecting Eating Disorders using the test split of the JiraiBench 1.0 dataset, focusing on classification metrics like Macro F1 score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Eating Disorder Detection | | Dataset (including any stated split) | JiraiBench 1.0 (test) | | Metric | Macro F1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 35 of 35 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Macro F1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Macro F1 | Result date | Report paper | | --- | --- | --- | --- | | SAS (English version) | 79.99 | Not recorded | 69608b7653fdd5c3617443a2 | | Self-Refine | 76.94 | Not recorded | 69608b7653fdd5c3617443a2 | | OWL | 76.86 | Not recorded | 69608b7653fdd5c3617443a2 | | S^3 Agent | 75.85 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot | 74.15 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot CoT | 73.86 | Not recorded | 69608b7653fdd5c3617443a2 | | SAS (English version) | 73.8 | Not recorded | 69608b7653fdd5c3617443a2 | | Plan-and-Solve | 72.74 | Not recorded | 69608b7653fdd5c3617443a2 | | SAS (English version) | 69.99 | Not recorded | 69608b7653fdd5c3617443a2 | | S^3 Agent | 69.06 | Not recorded | 69608b7653fdd5c3617443a2 | | Self-Refine | 68.66 | Not recorded | 69608b7653fdd5c3617443a2 | | Self-Refine | 61.36 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot | 57.58 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot CoT | 57.53 | Not recorded | 69608b7653fdd5c3617443a2 | | SAS (English version) | 56.42 | Not recorded | 69608b7653fdd5c3617443a2 | | S^3 Agent | 55.24 | Not recorded | 69608b7653fdd5c3617443a2 | | Plan-and-Solve | 53.96 | Not recorded | 69608b7653fdd5c3617443a2 | | Plan-and-Solve | 53.17 | Not recorded | 69608b7653fdd5c3617443a2 | | S^3 Agent | 52.99 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot | 52.95 | Not recorded | 69608b7653fdd5c3617443a2 | | OWL | 52.9 | Not recorded | 69608b7653fdd5c3617443a2 | | Self-Refine | 52.8 | Not recorded | 69608b7653fdd5c3617443a2 | | SAS (English version) | 52.8 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot CoT | 52.56 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot CoT | 52.42 | Not recorded | 69608b7653fdd5c3617443a2 | | OWL | 50.18 | Not recorded | 69608b7653fdd5c3617443a2 | | Self-Refine | 49.76 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot CoT | 47.46 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot | 46.29 | Not recorded | 69608b7653fdd5c3617443a2 | | Plan-and-Solve | 45.56 | Not recorded | 69608b7653fdd5c3617443a2 | | Plan-and-Solve | 45.23 | Not recorded | 69608b7653fdd5c3617443a2 | | Zero-shot | 44.52 | Not recorded | 69608b7653fdd5c3617443a2 | | OWL | 40.72 | Not recorded | 69608b7653fdd5c3617443a2 | | S^3 Agent | 39.56 | Not recorded | 69608b7653fdd5c3617443a2 | | OWL | 38.79 | Not recorded | 69608b7653fdd5c3617443a2 | ### SAS (English version) Macro F1: 79.99. Result ID: 699696705698665ec4dfe59f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### Self-Refine Macro F1: 76.94. Result ID: 699696705698665ec4dfe590. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### OWL Macro F1: 76.86. Result ID: 699696705698665ec4dfe59a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### S^3 Agent Macro F1: 75.85. Result ID: 699696705698665ec4dfe595. [Reporting paper]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### Zero-shot Macro F1: 74.15. Result ID: 699696705698665ec4dfe581. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### Zero-shot CoT Macro F1: 73.86. Result ID: 699696705698665ec4dfe586. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### SAS (English version) Macro F1: 73.8. Result ID: 699696705698665ec4dfe5a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### Plan-and-Solve Macro F1: 72.74. Result ID: 699696705698665ec4dfe58b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"DeepSeek V3.2"}. This record does not assert independent reproduction. ### SAS (English version) Macro F1: 69.99. Result ID: 699696705698665ec4dfe5a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### S^3 Agent Macro F1: 69.06. Result ID: 699696705698665ec4dfe597. [Reporting paper]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### Self-Refine Macro F1: 68.66. Result ID: 699696705698665ec4dfe592. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### Self-Refine Macro F1: 61.36. Result ID: 699696705698665ec4dfe58e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Zero-shot Macro F1: 57.58. Result ID: 699696705698665ec4dfe582. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### Zero-shot CoT Macro F1: 57.53. Result ID: 699696705698665ec4dfe587. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### SAS (English version) Macro F1: 56.42. Result ID: 699696705698665ec4dfe59e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### S^3 Agent Macro F1: 55.24. Result ID: 699696705698665ec4dfe593. [Reporting paper]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Plan-and-Solve Macro F1: 53.96. Result ID: 699696705698665ec4dfe58c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### Plan-and-Solve Macro F1: 53.17. Result ID: 699696705698665ec4dfe589. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### S^3 Agent Macro F1: 52.99. Result ID: 699696705698665ec4dfe596. [Reporting paper]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### Zero-shot Macro F1: 52.95. Result ID: 699696705698665ec4dfe580. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### OWL Macro F1: 52.9. Result ID: 699696705698665ec4dfe598. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Self-Refine Macro F1: 52.8. Result ID: 699696705698665ec4dfe591. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### SAS (English version) Macro F1: 52.8. Result ID: 699696705698665ec4dfe59d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### Zero-shot CoT Macro F1: 52.56. Result ID: 699696705698665ec4dfe585. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Zero-shot CoT Macro F1: 52.42. Result ID: 699696705698665ec4dfe584. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### OWL Macro F1: 50.18. Result ID: 699696705698665ec4dfe59b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Ministral-3-8B"}. This record does not assert independent reproduction. ### Self-Refine Macro F1: 49.76. Result ID: 699696705698665ec4dfe58f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Zero-shot CoT Macro F1: 47.46. Result ID: 699696705698665ec4dfe588. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### Zero-shot Macro F1: 46.29. Result ID: 699696705698665ec4dfe583. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### Plan-and-Solve Macro F1: 45.56. Result ID: 699696705698665ec4dfe58d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### Plan-and-Solve Macro F1: 45.23. Result ID: 699696705698665ec4dfe58a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Zero-shot Macro F1: 44.52. Result ID: 699696705698665ec4dfe57f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Qwen-2.5-7B"}. This record does not assert independent reproduction. ### OWL Macro F1: 40.72. Result ID: 699696705698665ec4dfe59c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Gemma-3-12B-it"}. This record does not assert independent reproduction. ### S^3 Agent Macro F1: 39.56. Result ID: 699696705698665ec4dfe594. [Reporting paper]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### OWL Macro F1: 38.79. Result ID: 699696705698665ec4dfe599. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"LLM Backbone":"Llama-3.1-8B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.