# SOP Prediction on Proposed SOP dataset Source: [SOP Prediction on Proposed SOP dataset]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:58:28.337Z Evaluation of SOP Prediction performance on the Proposed SOP dataset, reporting Precision, Recall, F1-score, GED, and GEDR. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | SOP Prediction | | Dataset (including any stated split) | Proposed SOP dataset | | Metric | Precision | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. - [GED](): Lower is better; unit: SCALAR. - [GEDR](): Higher is better; unit: SCALAR. ## Recorded results | Method | Precision | Result date | Report paper | | --- | --- | --- | --- | | SFT | 80.25 | Not recorded | 68fa771f1e209131cea7135b | | DAL | 78.11 | Not recorded | 68fa771f1e209131cea7135b | | SFT | 74.1 | Not recorded | 68fa771f1e209131cea7135b | | SFT | 72.19 | Not recorded | 68fa771f1e209131cea7135b | | TCoT | 69.2 | Not recorded | 68fa771f1e209131cea7135b | | SFT | 68.58 | Not recorded | 68fa771f1e209131cea7135b | | DAL | 64.14 | Not recorded | 68fa771f1e209131cea7135b | | TCoT | 60.81 | Not recorded | 68fa771f1e209131cea7135b | | TCoT | 50.95 | Not recorded | 68fa771f1e209131cea7135b | | TCoT | 48.29 | Not recorded | 68fa771f1e209131cea7135b | | DAL | 46.74 | Not recorded | 68fa771f1e209131cea7135b | | TCoT | 44.5 | Not recorded | 68fa771f1e209131cea7135b | | DAL | 42.84 | Not recorded | 68fa771f1e209131cea7135b | | DAL | 41.39 | Not recorded | 68fa771f1e209131cea7135b | | TCoT | 38.79 | Not recorded | 68fa771f1e209131cea7135b | | DAL | 35.19 | Not recorded | 68fa771f1e209131cea7135b | ### SFT Precision: 80.25. Result ID: 6994758b3a6c3148491d63b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen1.5-72b"}. This record does not assert independent reproduction. ### DAL Precision: 78.11. Result ID: 6994758b3a6c3148491d63af. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### SFT Precision: 74.1. Result ID: 6994758b3a6c3148491d63be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-70b"}. This record does not assert independent reproduction. ### SFT Precision: 72.19. Result ID: 6994758b3a6c3148491d63bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-8b"}. This record does not assert independent reproduction. ### TCoT Precision: 69.2. Result ID: 6994758b3a6c3148491d63b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4o"}. This record does not assert independent reproduction. ### SFT Precision: 68.58. Result ID: 6994758b3a6c3148491d63b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen1.5-14b"}. This record does not assert independent reproduction. ### DAL Precision: 64.14. Result ID: 6994758b3a6c3148491d63bc. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama3-70b"}. This record does not assert independent reproduction. ### TCoT Precision: 60.81. Result ID: 6994758b3a6c3148491d63bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-70b"}. This record does not assert independent reproduction. ### TCoT Precision: 50.95. Result ID: 6994758b3a6c3148491d63b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### TCoT Precision: 48.29. Result ID: 6994758b3a6c3148491d63b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen1.5-72b"}. This record does not assert independent reproduction. ### DAL Precision: 46.74. Result ID: 6994758b3a6c3148491d63b6. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen1.5-72b"}. This record does not assert independent reproduction. ### TCoT Precision: 44.5. Result ID: 6994758b3a6c3148491d63ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama3-8b"}. This record does not assert independent reproduction. ### DAL Precision: 42.84. Result ID: 6994758b3a6c3148491d63b3. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen1.5-14b"}. This record does not assert independent reproduction. ### DAL Precision: 41.39. Result ID: 6994758b3a6c3148491d63b1. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-3.5"}. This record does not assert independent reproduction. ### TCoT Precision: 38.79. Result ID: 6994758b3a6c3148491d63b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen1.5-14b"}. This record does not assert independent reproduction. ### DAL Precision: 35.19. Result ID: 6994758b3a6c3148491d63b9. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama3-8b"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.