# Target Generation on VAST Non-explicit (test) Source: [Target Generation on VAST Non-explicit (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:04:13.009Z Evaluation of Target Generation performance on the test split of the VAST Non-explicit dataset, utilizing metrics such as SS (SemSim), BTSD (%), and Human Evaluation (HE). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Target Generation | | Dataset (including any stated split) | VAST Non-explicit (test) | | Metric | SemSim Score (SS) | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [SemSim Score (SS)](): Higher is better; unit: SCALAR. - [BTSD (%)](): Lower is better; unit: PERCENT. - [Human Evaluation Score (HE)](): Higher is better; unit: SCALAR. ## Recorded results | Method | SemSim Score (SS) | Result date | Report paper | | --- | --- | --- | --- | | TSE-M | 0.9 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-8B | 0.85 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-70B | 0.85 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-large | 0.85 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-3.5 | 0.84 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-4o | 0.84 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-flash | 0.84 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-pro | 0.84 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-70B | 0.84 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-3.5 | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-4o | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-flash | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-pro | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-8B | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-small | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-small | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-large | 0.83 | Not recorded | 68fa78f21e209131cea7b5e1 | | TSE-B | 0.82 | Not recorded | 68fa78f21e209131cea7b5e1 | ### TSE-M SemSim Score (SS): 0.9. Result ID: 6995b1ed3badfaffe6b1a866. [Reporting paper]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Llama-3-8B SemSim Score (SS): 0.85. Result ID: 6995b1ed3badfaffe6b1a870. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Llama-3-70B SemSim Score (SS): 0.85. Result ID: 6995b1ed3badfaffe6b1a873. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Mistral-large SemSim Score (SS): 0.85. Result ID: 6995b1ed3badfaffe6b1a876. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### GPT-3.5 SemSim Score (SS): 0.84. Result ID: 6995b1ed3badfaffe6b1a868. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### GPT-4o SemSim Score (SS): 0.84. Result ID: 6995b1ed3badfaffe6b1a86a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Gemini-flash SemSim Score (SS): 0.84. Result ID: 6995b1ed3badfaffe6b1a86c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Gemini-pro SemSim Score (SS): 0.84. Result ID: 6995b1ed3badfaffe6b1a86f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Llama-3-70B SemSim Score (SS): 0.84. Result ID: 6995b1ed3badfaffe6b1a872. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### GPT-3.5 SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a869. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### GPT-4o SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a86b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Gemini-flash SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a86d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Gemini-pro SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a86e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Llama-3-8B SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a871. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Mistral-small SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a874. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Mistral-small SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a875. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Mistral-large SemSim Score (SS): 0.83. Result ID: 6995b1ed3badfaffe6b1a877. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### TSE-B SemSim Score (SS): 0.82. Result ID: 6995b1ed3badfaffe6b1a867. [Reporting paper]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.