# Template

Source: [Template](<https://www.sota2.com/research/dataset/template>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/template.md?page=2>): Follow this link to discover more pages.

- [Binary safety hallucination detection on EndoVis18-VQA Out-of-template (val)](<https://www.sota2.com/research/sota/binary-safety-hallucination-detection-on-endovis18-vqa-out-of-template-val.md>): Binary safety hallucination detection; EndoVis18-VQA Out-of-template (val).

- [Aggregate Reconstruction on NHANES 8 templates (holdout)](<https://www.sota2.com/research/sota/aggregate-reconstruction-on-nhanes-8-templates-holdout.md>): Aggregate Reconstruction; NHANES 8 templates (holdout).

- [Surgical Video Question Answering on REAL-Colon-VQA (Out-of-template)](<https://www.sota2.com/research/sota/surgical-video-question-answering-on-real-colon-vqa-out-of-template.md>): Surgical Video Question Answering; REAL-Colon-VQA (Out-of-template).

- [Surgical Video Question Answering on REAL-Colon-VQA In-template](<https://www.sota2.com/research/sota/surgical-video-question-answering-on-real-colon-vqa-in-template.md>): Surgical Video Question Answering; REAL-Colon-VQA In-template.

- [Document Information Extraction on VRDU Ad-buy Form Mixed Template](<https://www.sota2.com/research/sota/document-information-extraction-on-vrdu-ad-buy-form-mixed-template.md>): Document Information Extraction; VRDU Ad-buy Form Mixed Template.

- [Document Information Extraction on VRDU Registration Form Mixed Template](<https://www.sota2.com/research/sota/document-information-extraction-on-vrdu-registration-form-mixed-template.md>): Document Information Extraction; VRDU Registration Form Mixed Template.

- [Reconstruction Error Analysis on Agent-eval 8 templates user agent GPT-5.4 nano (aggregate)](<https://www.sota2.com/research/sota/reconstruction-error-analysis-on-agent-eval-8-templates-user-agent-gpt-5-4-nano-aggregate.md>): Reconstruction Error Analysis; Agent-eval 8 templates user agent GPT-5.4 nano (aggregate).

- [Binary Safety Hallucination Detection on EndoVis VQA In-template 18 (val)](<https://www.sota2.com/research/sota/binary-safety-hallucination-detection-on-endovis-vqa-in-template-18-val.md>): Binary safety hallucination detection; EndoVis VQA In-template 18 (val).

- [Jailbreak Defense on GPTFuzz, TAP, GCG, AutoDAN, and Template](<https://www.sota2.com/research/sota/jailbreak-defense-on-gptfuzz-tap-gcg-autodan-and-template.md>): Jailbreak Defense; Jailbreak Attack Benchmarks (GPTFuzz, TAP, GCG, AutoDAN, Template).

- [Surgical Video Question Answering on EndoVis18-VQA Out-of-template](<https://www.sota2.com/research/sota/surgical-video-question-answering-on-endovis18-vqa-out-of-template.md>): Surgical Video Question Answering; EndoVis18-VQA Out-of-template.

- [Surgical Video Question Answering on EndoVis-VQA In-template 18](<https://www.sota2.com/research/sota/surgical-video-question-answering-on-endovis-vqa-in-template-18.md>): Surgical Video Question Answering; EndoVis-VQA In-template 18.

- [Text-to-Video Retrieval on Something-to-Something Template v2](<https://www.sota2.com/research/sota/text-to-video-retrieval-on-something-to-something-template-v2.md>): Text-to-Video Retrieval; Something-to-Something Template v2.

- [Knowledge Unlearning on GONE FB Templates Wikidata](<https://www.sota2.com/research/sota/knowledge-unlearning-on-gone-fb-templates-wikidata.md>): Knowledge Unlearning; GONE FB Templates Wikidata.

- [Knowledge Unlearning on GONE Wikidata (QA Templates)](<https://www.sota2.com/research/sota/knowledge-unlearning-on-gone-wikidata-qa-templates.md>): Knowledge Unlearning; GONE Wikidata (QA Templates).

- [Mobile Agent Decision-making on AndroidWorld (Evaluation set 116 templates)](<https://www.sota2.com/research/sota/mobile-agent-decision-making-on-androidworld-evaluation-set-116-templates.md>): Mobile Agent Decision-making; AndroidWorld (Evaluation set 116 templates).

- [Jailbreak Defense on Template](<https://www.sota2.com/research/sota/jailbreak-defense-on-template.md>): Jailbreak Defense; Template.

- [Affine Image Registration on Subject-to-template image registration](<https://www.sota2.com/research/sota/affine-image-registration-on-subject-to-template-image-registration.md>): Affine Image Registration; Subject-to-template image registration.

- [Few-concept Erasure (Single Style) on Artistic style templates and MS-COCO](<https://www.sota2.com/research/sota/few-concept-erasure-single-style-on-artistic-style-templates-and-ms-coco.md>): Few-concept Erasure (Single Style); Artistic style templates and MS-COCO.

- [Few-concept Erasure (Multi-Instance) on MS-COCO Instance templates](<https://www.sota2.com/research/sota/few-concept-erasure-multi-instance-on-ms-coco-instance-templates.md>): Few-concept Erasure (Multi-Instance); MS-COCO Instance templates.

- [Text-to-SQL on GEOQUERY template (test)](<https://www.sota2.com/research/sota/text-to-sql-on-geoquery-template-test.md>): Text-to-SQL; GEOQUERY template (test).

- [Text-to-SQL on ATIS template (test)](<https://www.sota2.com/research/sota/text-to-sql-on-atis-template-test.md>): Text-to-SQL; ATIS template (test).

- [Rendering on Tanks & Templates](<https://www.sota2.com/research/sota/rendering-on-tanks-and-templates.md>): Rendering; Tanks & Templates.

- [Depth-aware Multimodal Question Answering on Depth Template Benchmark](<https://www.sota2.com/research/sota/depth-aware-multimodal-question-answering-on-depth-template-benchmark.md>): Depth-aware Multimodal Question Answering; Depth Template Benchmark.

- [Object Type Prediction on Template Shift (TS)](<https://www.sota2.com/research/sota/object-type-prediction-on-template-shift-ts.md>): Object type prediction; Template Shift (TS).

- [Trajectory Generation via SCP on Spacecraft Proximity Operation Behavior 5 (unseen command templates)](<https://www.sota2.com/research/sota/trajectory-generation-via-scp-on-spacecraft-proximity-operation-behavior-5-unseen-command-templates.md>): Trajectory Generation via SCP; Spacecraft Proximity Operation Behavior 5 (unseen command templates).

- [Trajectory Generation via SCP on Spacecraft Proximity Operation Behavior 4 unseen command templates](<https://www.sota2.com/research/sota/trajectory-generation-via-scp-on-spacecraft-proximity-operation-behavior-4-unseen-command-templates.md>): Trajectory Generation via SCP; Spacecraft Proximity Operation Behavior 4 unseen command templates.

- [Trajectory Generation via SCP on Spacecraft Proximity Operation unseen command templates Behavior 3](<https://www.sota2.com/research/sota/trajectory-generation-via-scp-on-spacecraft-proximity-operation-unseen-command-templates-behavior-3.md>): Trajectory Generation via SCP; Spacecraft Proximity Operation unseen command templates Behavior 3.

- [Trajectory Generation via SCP on Spacecraft Proximity Operation Behavior 2 (unseen command templates)](<https://www.sota2.com/research/sota/trajectory-generation-via-scp-on-spacecraft-proximity-operation-behavior-2-unseen-command-templates.md>): Trajectory Generation via SCP; Spacecraft Proximity Operation Behavior 2 (unseen command templates).

- [Trajectory Generation via SCP on Spacecraft Proximity Operation unseen command templates Behavior 1](<https://www.sota2.com/research/sota/trajectory-generation-via-scp-on-spacecraft-proximity-operation-unseen-command-templates-behavior-1.md>): Trajectory Generation via SCP; Spacecraft Proximity Operation unseen command templates Behavior 1.

- [Trajectory Generation via SCP on Spacecraft Proximity Operation Behavior 0 (unseen command templates)](<https://www.sota2.com/research/sota/trajectory-generation-via-scp-on-spacecraft-proximity-operation-behavior-0-unseen-command-templates.md>): Trajectory Generation via SCP; Spacecraft Proximity Operation Behavior 0 (unseen command templates).

- [Access Control on 12 template–attack datasets (test)](<https://www.sota2.com/research/sota/access-control-on-12-template-attack-datasets-test.md>): Access Control; 12 template–attack datasets (test).

- [3D Building Generation on Prompt Suite 60 templates](<https://www.sota2.com/research/sota/3d-building-generation-on-prompt-suite-60-templates.md>): 3D Building Generation; Prompt Suite 60 templates.

- [Language-driven scene representation on ALFRED Template Shift \[TS\]](<https://www.sota2.com/research/sota/language-driven-scene-representation-on-alfred-template-shift-ts.md>): Language-driven scene representation; ALFRED Template Shift \[TS\].

- [Text-to-Image Generation on SD template memorization 2.0](<https://www.sota2.com/research/sota/text-to-image-generation-on-sd-template-memorization-2-0.md>): Text-to-Image Generation; SD template memorization 2.0.

- [Text-to-Image Generation on SD template memorization 1.4](<https://www.sota2.com/research/sota/text-to-image-generation-on-sd-template-memorization-1-4.md>): Text-to-Image Generation; SD template memorization 1.4.

- [Physical Reasoning on PHYRE-1B cross-template (test)](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-1b-cross-template-test.md>): Physical Reasoning; PHYRE-1B cross-template (test).

- [Physical Reasoning on PHYRE-1B within-template (test)](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-1b-within-template-test.md>): Physical Reasoning; PHYRE-1B within-template (test).

- [Text-to-SQL on SCHOLAR template splits (test)](<https://www.sota2.com/research/sota/text-to-sql-on-scholar-template-splits-test.md>): Text-to-SQL; SCHOLAR template splits (test).

- [Concept Erasure on Instance Templates (Snoopy, Mickey, Spongebob, Pikachu)](<https://www.sota2.com/research/sota/concept-erasure-on-instance-templates-snoopy-mickey-spongebob-pikachu.md>): Concept Erasure; Instance templates Snoopy & Mickey erasure.

- [Concept Erasure on Instance templates Snoopy erasure](<https://www.sota2.com/research/sota/concept-erasure-on-instance-templates-snoopy-erasure.md>): Concept Erasure; Instance templates Snoopy erasure.

- [Few-concept Erasure (Single Instance) on MS-COCO Instance templates](<https://www.sota2.com/research/sota/few-concept-erasure-single-instance-on-ms-coco-instance-templates.md>): Few-concept Erasure (Single Instance); MS-COCO Instance templates.

- [Medical Image Registration on Anatomical Brain Structures (subject-to-template)](<https://www.sota2.com/research/sota/medical-image-registration-on-anatomical-brain-structures-subject-to-template.md>): Medical Image Registration; Anatomical Brain Structures (subject-to-template).

- [Image Registration on Subject-to-template registration](<https://www.sota2.com/research/sota/image-registration-on-subject-to-template-registration.md>): Image Registration; Subject-to-template registration.

- [Semantic Parsing on SCAN Template](<https://www.sota2.com/research/sota/semantic-parsing-on-scan-template.md>): Semantic Parsing; SCAN Template.

- [Physical Reasoning on PHYRE Cross-template 1.0](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-cross-template-1-0.md>): Physical Reasoning; PHYRE Cross-template 1.0.

- [Physical Reasoning on PHYRE Within-template 1.0](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-within-template-1-0.md>): Physical Reasoning; PHYRE Within-template 1.0.

- [Instruction Following on RoboTwin-IF Clean (Held-Out Templates)](<https://www.sota2.com/research/sota/instruction-following-on-robotwin-if-clean-held-out-templates.md>): Instruction-Following Robot Manipulation; RoboTwin-IF Clean (held-out unseen instruction templates).

- [Question Answering on DBLP-QuAD (held-out templates)](<https://www.sota2.com/research/sota/question-answering-on-dblp-quad-held-out-templates.md>): Question Answering; DBLP-QuAD (held-out templates).

- [Visual Question Answering on EndoVis18-VQA Out-of-template (val)](<https://www.sota2.com/research/sota/visual-question-answering-on-endovis18-vqa-out-of-template-val.md>): Visual Question Answering; EndoVis18-VQA Out-of-template (val).

- [Artistic Style Erasure on Artistic Style Templates Target: Monet](<https://www.sota2.com/research/sota/artistic-style-erasure-on-artistic-style-templates-target-monet.md>): Artistic Style Erasure; Artistic Style Templates Target: Monet.

- [Artistic Style Erasure on Artistic Style Templates Target: Picasso](<https://www.sota2.com/research/sota/artistic-style-erasure-on-artistic-style-templates-target-picasso.md>): Artistic Style Erasure; Artistic Style Templates Target: Picasso.

- [Artistic Style Erasure on Artistic Style Templates Target: Van Gogh](<https://www.sota2.com/research/sota/artistic-style-erasure-on-artistic-style-templates-target-van-gogh.md>): Artistic Style Erasure; Artistic Style Templates Target: Van Gogh.

- [Helpfulness on GPT-4 Evaluation Template T2 (overall)](<https://www.sota2.com/research/sota/helpfulness-on-gpt-4-evaluation-template-t2-overall.md>): Helpfulness; GPT-4 Evaluation Template T2 (overall).

- [Harmlessness on GPT-4 Evaluation Template T2 (overall)](<https://www.sota2.com/research/sota/harmlessness-on-gpt-4-evaluation-template-t2-overall.md>): Harmlessness; GPT-4 Evaluation Template T2 (overall).

- [Helpfulness on Template T3 GPT-4 evaluation (test)](<https://www.sota2.com/research/sota/helpfulness-on-template-t3-gpt-4-evaluation-test.md>): Helpfulness; Template T3 GPT-4 evaluation (test).

- [Harmlessness on Template T3 GPT-4 evaluation (test)](<https://www.sota2.com/research/sota/harmlessness-on-template-t3-gpt-4-evaluation-test.md>): Harmlessness; Template T3 GPT-4 evaluation (test).

- [Physical Reasoning on PHYRE-2B cross-template (test)](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-2b-cross-template-test.md>): Physical Reasoning; PHYRE-2B cross-template (test).

- [Physical Reasoning on PHYRE-2B within-template (test)](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-2b-within-template-test.md>): Physical Reasoning; PHYRE-2B within-template (test).

- [Text-to-Image Generation on Structured Templates Animals-Objects](<https://www.sota2.com/research/sota/text-to-image-generation-on-structured-templates-animals-objects.md>): Text-to-Image Generation; Structured Templates Animals-Objects.

- [Text-to-Image Generation on Structured Templates Objects](<https://www.sota2.com/research/sota/text-to-image-generation-on-structured-templates-objects.md>): Text-to-Image Generation; Structured Templates Objects.

- [Video-to-Action Retrieval on SS template v2](<https://www.sota2.com/research/sota/video-to-action-retrieval-on-ss-template-v2.md>): Video-to-Action Retrieval; SS template v2.

- [Physical Reasoning on PHYRE cross-template B](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-cross-template-b.md>): Physical Reasoning; PHYRE cross-template B.

- [Physical Reasoning on PHYRE within-template B](<https://www.sota2.com/research/sota/physical-reasoning-on-phyre-within-template-b.md>): Physical Reasoning; PHYRE within-template B.

- [Video Retrieval on Something-Something SSv2-template v2 (test val)](<https://www.sota2.com/research/sota/video-retrieval-on-something-something-ssv2-template-v2-test-val.md>): Video Retrieval; Something-Something SSv2-template v2 (test val).

- [Text-to-Image Generation on Standard "A photo of a {profession}" Prompt Template (Reference)](<https://www.sota2.com/research/sota/text-to-image-generation-on-standard-a-photo-of-a-profession-prompt-template-reference.md>): Text-to-Image Generation; Standard "A photo of a {profession}" Prompt Template (Reference).

- [Agent Memory Management on FORGETEVAL Template suite (1000 cases)](<https://www.sota2.com/research/sota/agent-memory-management-on-forgeteval-template-suite-1000-cases.md>): Agent Memory Management; FORGETEVAL Template suite (1000 cases).

- [Multimodal Infrared Understanding on Infrared Template Benchmark](<https://www.sota2.com/research/sota/multimodal-infrared-understanding-on-infrared-template-benchmark.md>): Multimodal Infrared Understanding; Infrared Template Benchmark.

- [Multi-intent detection on CoMIX-SHIFT (Template holdout)](<https://www.sota2.com/research/sota/multi-intent-detection-on-comix-shift-template-holdout.md>): Multi-intent detection; CoMIX-SHIFT (Template holdout).

- [Retrosynthesis Prediction on Rare Template Evaluation (hard instances)](<https://www.sota2.com/research/sota/retrosynthesis-prediction-on-rare-template-evaluation-hard-instances.md>): Retrosynthesis Prediction; Rare Template Evaluation (hard instances).

- [Semantic Parsing on GeoQuery (Template)](<https://www.sota2.com/research/sota/semantic-parsing-on-geoquery-template.md>): Semantic Parsing; GeoQuery (Template).

- [Segmentation on N=116 template dataset](<https://www.sota2.com/research/sota/segmentation-on-n-116-template-dataset.md>): Segmentation; N=116 template dataset.

- [Safety Detection on SorryBench wrapped with HarmBench templates (held-out)](<https://www.sota2.com/research/sota/safety-detection-on-sorrybench-wrapped-with-harmbench-templates-held-out.md>): Safety Detection; SorryBench wrapped with HarmBench templates (held-out).

- [Generative circuit design on Analog board-level circuit design templates](<https://www.sota2.com/research/sota/generative-circuit-design-on-analog-board-level-circuit-design-templates.md>): Generative circuit design; Analog board-level circuit design templates.

- [3D Head Avatar Animation on User Study 50 video pairs FLAME2020 template based (test)](<https://www.sota2.com/research/sota/3d-head-avatar-animation-on-user-study-50-video-pairs-flame2020-template-based-test.md>): 3D Head Avatar Animation; User Study 50 video pairs FLAME2020 template based (test).

- [Semantic Parsing on GeoQuery Template split](<https://www.sota2.com/research/sota/semantic-parsing-on-geoquery-template-split.md>): Semantic Parsing; GeoQuery Template split.

- [Combinatorial Generalization on PhyWorld (in-template)](<https://www.sota2.com/research/sota/combinatorial-generalization-on-phyworld-in-template.md>): Combinatorial Generalization; PhyWorld (in-template).

- [Combinatorial Generalization on PhyWorld (out-of-template)](<https://www.sota2.com/research/sota/combinatorial-generalization-on-phyworld-out-of-template.md>): Combinatorial Generalization; PhyWorld (out-of-template).

- [Ranking on Adobe Express template interaction logs (JP)](<https://www.sota2.com/research/sota/ranking-on-adobe-express-template-interaction-logs-jp.md>): Ranking; Adobe Express template interaction logs (JP).

- [Ranking on Adobe Express template interaction logs (GB)](<https://www.sota2.com/research/sota/ranking-on-adobe-express-template-interaction-logs-gb.md>): Ranking; Adobe Express template interaction logs (GB).

- [Ranking on Adobe Express template interaction logs (FR)](<https://www.sota2.com/research/sota/ranking-on-adobe-express-template-interaction-logs-fr.md>): Ranking; Adobe Express template interaction logs FR.
