# Target Generation on VAST Explicit (test) Source: [Target Generation on VAST Explicit (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:03:18.490Z Evaluation of Target Generation performance on the test split of the VAST Explicit dataset, using metrics like SS (SemSim), BTSD, and Human Evaluation. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Target Generation | | Dataset (including any stated split) | VAST Explicit (test) | | Metric | SS (SemSim) | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [SS (SemSim)](): Higher is better; unit: SCALAR. - [BTSD Error (%)](): Lower is better; unit: PERCENT. - [Human Evaluation Score (HE)](): Higher is better; unit: SCALAR. ## Recorded results | Method | SS (SemSim) | Result date | Report paper | | --- | --- | --- | --- | | TSE-M | 0.96 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-pro | 0.89 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-4o | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-flash | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-8B | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-70B | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-70B | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-large | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-large | 0.88 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-3.5 | 0.87 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-3.5 | 0.87 | Not recorded | 68fa78f21e209131cea7b5e1 | | GPT-4o | 0.87 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-flash | 0.87 | Not recorded | 68fa78f21e209131cea7b5e1 | | Llama-3-8B | 0.87 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-small | 0.87 | Not recorded | 68fa78f21e209131cea7b5e1 | | TSE-B | 0.86 | Not recorded | 68fa78f21e209131cea7b5e1 | | Gemini-pro | 0.86 | Not recorded | 68fa78f21e209131cea7b5e1 | | Mistral-small | 0.85 | Not recorded | 68fa78f21e209131cea7b5e1 | ### TSE-M SS (SemSim): 0.96. Result ID: 6995b1ed3badfaffe6b1a842. [Reporting paper]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Gemini-pro SS (SemSim): 0.89. Result ID: 6995b1ed3badfaffe6b1a84b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### GPT-4o SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a847. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Gemini-flash SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a849. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Llama-3-8B SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a84c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Llama-3-70B SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a84e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Llama-3-70B SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a84f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Mistral-large SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a852. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Mistral-large SS (SemSim): 0.88. Result ID: 6995b1ed3badfaffe6b1a853. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### GPT-3.5 SS (SemSim): 0.87. Result ID: 6995b1ed3badfaffe6b1a844. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### GPT-3.5 SS (SemSim): 0.87. Result ID: 6995b1ed3badfaffe6b1a845. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### GPT-4o SS (SemSim): 0.87. Result ID: 6995b1ed3badfaffe6b1a846. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Gemini-flash SS (SemSim): 0.87. Result ID: 6995b1ed3badfaffe6b1a848. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Llama-3-8B SS (SemSim): 0.87. Result ID: 6995b1ed3badfaffe6b1a84d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### Mistral-small SS (SemSim): 0.87. Result ID: 6995b1ed3badfaffe6b1a851. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG&SD"}. This record does not assert independent reproduction. ### TSE-B SS (SemSim): 0.86. Result ID: 6995b1ed3badfaffe6b1a843. [Reporting paper]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Gemini-pro SS (SemSim): 0.86. Result ID: 6995b1ed3badfaffe6b1a84a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. ### Mistral-small SS (SemSim): 0.85. Result ID: 6995b1ed3badfaffe6b1a850. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Approach":"TG+SD"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.