# UTR

Source: [UTR](<https://www.sota2.com/research/dataset/utr>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/utr.md?page=2>): Follow this link to discover more pages.

- [Program Repair on Real misspecified programs neutral briefs](<https://www.sota2.com/research/sota/program-repair-on-real-misspecified-programs-neutral-briefs.md>): Program Repair; Real misspecified programs neutral briefs.

- [Relational Reasoning on CLUTRR](<https://www.sota2.com/research/sota/relational-reasoning-on-clutrr.md>): Relational Reasoning; CLUTRR.

- [Logical Reasoning on CLUTRR](<https://www.sota2.com/research/sota/logical-reasoning-on-clutrr.md>): Logical Reasoning; CLUTRR.

- [Classification on National Health and Nutrition Examination Survey Employee 2013–2014 cycle (random sample splits)](<https://www.sota2.com/research/sota/classification-on-national-health-and-nutrition-examination-survey-employee-2013-2014-cycle-random-sample-splits.md>): Classification; National Health and Nutrition Examination Survey Employee 2013–2014 cycle (random sample splits).

- [Causal Estimation on Street Outreach Data](<https://www.sota2.com/research/sota/causal-estimation-on-street-outreach-data.md>): Causal Estimation; Street Outreach Data.

- [Logical Reasoning on CLUTRR (test)](<https://www.sota2.com/research/sota/logical-reasoning-on-clutrr-test.md>): Logical Reasoning; CLUTRR (test).

- [SAE steering on Neutral prefixes dataset](<https://www.sota2.com/research/sota/sae-steering-on-neutral-prefixes-dataset.md>): SAE steering; Neutral prefixes dataset.

- [Sentiment Steering on OpenWebText Neutral to Negative (test)](<https://www.sota2.com/research/sota/sentiment-steering-on-openwebtext-neutral-to-negative-test.md>): Sentiment Steering; OpenWebText Neutral to Negative (test).

- [Sentiment Steering on OpenWebText Neutral to Positive (test)](<https://www.sota2.com/research/sota/sentiment-steering-on-openwebtext-neutral-to-positive-test.md>): Sentiment Steering; OpenWebText Neutral to Positive (test).

- [Retrieval on ChunQiuTR official (test)](<https://www.sota2.com/research/sota/retrieval-on-chunqiutr-official-test.md>): Retrieval; ChunQiuTR official (test).

- [Hybrid Reasoning on CLUTRR (test)](<https://www.sota2.com/research/sota/hybrid-reasoning-on-clutrr-test.md>): Hybrid Reasoning; CLUTRR (test).

- [Optical Character Recognition on UTRSet-Real (val)](<https://www.sota2.com/research/sota/optical-character-recognition-on-utrset-real-val.md>): Optical Character Recognition; UTRSet-Real (val).

- [Text-to-Image Fairness Evaluation on Attribute-neutral prompts 8 professions (test)](<https://www.sota2.com/research/sota/text-to-image-fairness-evaluation-on-attribute-neutral-prompts-8-professions-test.md>): Text-to-Image Fairness Evaluation; Attribute-neutral prompts 8 professions (test).

- [3D Reconstruction on Real experimental neutron CT scanner dataset](<https://www.sota2.com/research/sota/3d-reconstruction-on-real-experimental-neutron-ct-scanner-dataset.md>): 3D Reconstruction; Real experimental neutron CT scanner dataset.

- [State Reconstruction on neutrophil Gaussian noise (test)](<https://www.sota2.com/research/sota/state-reconstruction-on-neutrophil-gaussian-noise-test.md>): State Reconstruction; neutrophil Gaussian noise (test).

- [State Reconstruction on neutrophil Correlated Gaussian noise (test)](<https://www.sota2.com/research/sota/state-reconstruction-on-neutrophil-correlated-gaussian-noise-test.md>): State Reconstruction; neutrophil Correlated Gaussian noise (test).

- [State Reconstruction on neutrophil Student-t noise (test)](<https://www.sota2.com/research/sota/state-reconstruction-on-neutrophil-student-t-noise-test.md>): State Reconstruction; neutrophil Student-t noise (test).

- [Salient Object Detection on DUTRGBD](<https://www.sota2.com/research/sota/salient-object-detection-on-dutrgbd.md>): Salient Object Detection; DUTRGBD.

- [Nutrition Estimation on Nutrition5k](<https://www.sota2.com/research/sota/nutrition-estimation-on-nutrition5k.md>): Nutrition Estimation; Nutrition5k.

- [Inductive Reasoning on Clutrr (Pass@1)](<https://www.sota2.com/research/sota/inductive-reasoning-on-clutrr-pass-at-1.md>): Inductive Reasoning; Clutrr.

- [Binary Classification on CLUTRR](<https://www.sota2.com/research/sota/binary-classification-on-clutrr.md>): Binary Classification; CLUTRR.

- [Offline Model-Based Optimization on UTR](<https://www.sota2.com/research/sota/offline-model-based-optimization-on-utr.md>): Offline Model-Based Optimization; UTR.

- [Signal Reconstruction on Neutron Scattering](<https://www.sota2.com/research/sota/signal-reconstruction-on-neutron-scattering.md>): Signal Reconstruction; Neutron Scattering.

- [Face Recognition Attribution on ARface (neutral)](<https://www.sota2.com/research/sota/face-recognition-attribution-on-arface-neutral.md>): Face Recognition Attribution; ARface (neutral).

- [Image Quality Assessment on Neutron](<https://www.sota2.com/research/sota/image-quality-assessment-on-neutron.md>): Image Quality Assessment; Neutron.

- [Nutrient prediction on NutriBench](<https://www.sota2.com/research/sota/nutrient-prediction-on-nutribench.md>): Nutrient prediction; NutriBench.

- [Audio-Video Attention Modeling on Coutrot2](<https://www.sota2.com/research/sota/audio-video-attention-modeling-on-coutrot2.md>): Audio-Video Attention Modeling; Coutrot2.

- [Audio-Video Attention Modeling on Coutrot1](<https://www.sota2.com/research/sota/audio-video-attention-modeling-on-coutrot1.md>): Audio-Video Attention Modeling; Coutrot1.

- [Nutrition Care Documentation Quality Assessment on Stroke Survivors 1.0 (test)](<https://www.sota2.com/research/sota/nutrition-care-documentation-quality-assessment-on-stroke-survivors-1-0-test.md>): Nutrition care documentation quality assessment; Nutrition care documentation for 330 stroke survivors 1.0 (test).

- [Bias Mitigation on 100 Gender-Neutral Prompts (test)](<https://www.sota2.com/research/sota/bias-mitigation-on-100-gender-neutral-prompts-test.md>): Bias Mitigation; 100 Gender-Neutral Prompts (test).

- [Density modeling on Nutrient intake data](<https://www.sota2.com/research/sota/density-modeling-on-nutrient-intake-data.md>): Density modeling; Nutrient intake data.

- [Image Classification on FER2013 Happy, Surprised and Neutral (test)](<https://www.sota2.com/research/sota/image-classification-on-fer2013-happy-surprised-and-neutral-test.md>): Image Classification; FER2013 Happy, Surprised and Neutral (test).

- [Contextual Discrimination on Neutral and Stigma (test)](<https://www.sota2.com/research/sota/contextual-discrimination-on-neutral-and-stigma-test.md>): Contextual Discrimination; Neutral and Stigma (test).

- [Patient Simulation on Neutral (test)](<https://www.sota2.com/research/sota/patient-simulation-on-neutral-test.md>): Patient Simulation; Neutral (test).

- [Talking Face Generation on MEAD Neutral](<https://www.sota2.com/research/sota/talking-face-generation-on-mead-neutral.md>): Talking Face Generation; MEAD Neutral.

- [Fairness Evaluation on Utrecht](<https://www.sota2.com/research/sota/fairness-evaluation-on-utrecht.md>): Fairness Evaluation; Utrecht.

- [3D Face Reconstruction on NeRSemble-SVFR (Neutral)](<https://www.sota2.com/research/sota/3d-face-reconstruction-on-nersemble-svfr-neutral.md>): 3D Face Reconstruction; NeRSemble-SVFR (Neutral).

- [Ranking Consistency Analysis on MMLU-Pro Nutrition health](<https://www.sota2.com/research/sota/ranking-consistency-analysis-on-mmlu-pro-nutrition-health.md>): Ranking Consistency Analysis; MMLU-Pro Nutrition health.

- [Image Classification on CelebA Synthetic Patch Neutral Distribution (Dneut) shortcut (blond hair) (test)](<https://www.sota2.com/research/sota/image-classification-on-celeba-synthetic-patch-neutral-distribution-dneut-shortcut-blond-hair-test.md>): Image Classification; CelebA Synthetic Patch Neutral Distribution (Dneut) shortcut (blond hair) (test).

- [Single-image 3D Face Reconstruction on NoW neutral](<https://www.sota2.com/research/sota/single-image-3d-face-reconstruction-on-now-neutral.md>): Single-image 3D Face Reconstruction; NoW neutral.

- [Empathetic Dialogue Generation on Empathetic Dialogues Neutral](<https://www.sota2.com/research/sota/empathetic-dialogue-generation-on-empathetic-dialogues-neutral.md>): Empathetic Dialogue Generation; Empathetic Dialogues Neutral.

- [Text-to-Image Generation on SD Attribute-neutral prompts Gender-Profession 1.5](<https://www.sota2.com/research/sota/text-to-image-generation-on-sd-attribute-neutral-prompts-gender-profession-1-5.md>): Text-to-Image Generation; SD Attribute-neutral prompts Gender-Profession 1.5.

- [Empathetic Speech Generation on Sympatheia Neutral](<https://www.sota2.com/research/sota/empathetic-speech-generation-on-sympatheia-neutral.md>): Empathetic Speech Generation; Sympatheia Neutral.

- [Quality Estimation on Gender-ambiguous EN-DE ES IT Neutral vs. Gendered](<https://www.sota2.com/research/sota/quality-estimation-on-gender-ambiguous-en-de-es-it-neutral-vs-gendered.md>): Quality Estimation; Gender-ambiguous EN-DE ES IT Neutral vs. Gendered.

- [Absolute Weight Estimation on Nutrition5k](<https://www.sota2.com/research/sota/absolute-weight-estimation-on-nutrition5k.md>): Absolute Weight Estimation; Nutrition5k.

- [Automatic Speech Recognition on In-house ASR Nutrition domain (evaluation set)](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-in-house-asr-nutrition-domain-evaluation-set.md>): Automatic Speech Recognition; In-house ASR Nutrition domain (evaluation set).

- [Self-reconstruction on Neutral Set talking videos 5s (train)](<https://www.sota2.com/research/sota/self-reconstruction-on-neutral-set-talking-videos-5s-train.md>): Self-reconstruction; Neutral Set talking videos 5s (train).

- [Blind Room Impulse Response (RIR) Estimation on BUTReverbDB and OpenAIR Out-of-domain](<https://www.sota2.com/research/sota/blind-room-impulse-response-rir-estimation-on-butreverbdb-and-openair-out-of-domain.md>): Blind Room Impulse Response (RIR) Estimation; BUTReverbDB and OpenAIR Out-of-domain.

- [Single-attribute Controllable Text Generation on PPLM 35 Neutral Prompts GPT2-medium base (test)](<https://www.sota2.com/research/sota/single-attribute-controllable-text-generation-on-pplm-35-neutral-prompts-gpt2-medium-base-test.md>): Single-attribute Controllable Text Generation; PPLM 35 Neutral Prompts GPT2-medium base (test).

- [Video Saliency Prediction on Coutrot2 (test)](<https://www.sota2.com/research/sota/video-saliency-prediction-on-coutrot2-test.md>): Video Saliency Prediction; Coutrot2 (test).

- [Video Saliency Prediction on Coutrot1 (test)](<https://www.sota2.com/research/sota/video-saliency-prediction-on-coutrot1-test.md>): Video Saliency Prediction; Coutrot1 (test).

- [Privacy Leakage Evaluation on AgentDojo external-validity (66 read-only tasks (20 privacy-bearing + 46 neutral))](<https://www.sota2.com/research/sota/privacy-leakage-evaluation-on-agentdojo-external-validity-66-read-only-tasks-20-privacy-bearing-plus-46-neutral.md>): Privacy Leakage Evaluation; AgentDojo external-validity (66 read-only tasks (20 privacy-bearing + 46 neutral)).

- [Emotional Outcome Evaluation on PANAS Neutral Attitude](<https://www.sota2.com/research/sota/emotional-outcome-evaluation-on-panas-neutral-attitude.md>): Emotional Outcome Evaluation; PANAS Neutral Attitude.

- [3D reconstruction on Synthetic dataset Neutrophils](<https://www.sota2.com/research/sota/3d-reconstruction-on-synthetic-dataset-neutrophils.md>): 3D reconstruction; Synthetic dataset Neutrophils.

- [Performance estimation error on CUTRACT (Target)](<https://www.sota2.com/research/sota/performance-estimation-error-on-cutract-target.md>): Performance estimation error; CUTRACT (Target).

- [Speech Emotion Recognition on IEMOCAP (4-class test)](<https://www.sota2.com/research/sota/speech-emotion-recognition-on-iemocap-4-class-test.md>): Speech Emotion Recognition; IEMOCAP angry, happy, neutral, sad classes (test).

- [Historical Appearance Restoration on Fangshan Stone Sutra Severe Damage (test)](<https://www.sota2.com/research/sota/historical-appearance-restoration-on-fangshan-stone-sutra-severe-damage-test.md>): Historical Appearance Restoration; Fangshan Stone Sutra Severe Damage (test).

- [Historical Appearance Restoration on Fangshan Stone Sutra Medium Damage (test)](<https://www.sota2.com/research/sota/historical-appearance-restoration-on-fangshan-stone-sutra-medium-damage-test.md>): Historical Appearance Restoration; Fangshan Stone Sutra Medium Damage (test).

- [Historical Appearance Restoration on Fangshan Stone Sutra Light Damage (test)](<https://www.sota2.com/research/sota/historical-appearance-restoration-on-fangshan-stone-sutra-light-damage-test.md>): Historical Appearance Restoration; Fangshan Stone Sutra Light Damage (test).

- [Text-to-Image Generation on attribute-neutral prompts (8 professions) (test)](<https://www.sota2.com/research/sota/text-to-image-generation-on-attribute-neutral-prompts-8-professions-test.md>): Text-to-Image Generation; attribute-neutral prompts (8 professions) (test).

- [Neutrosophic Evaluation on Neutrosophic Evaluation Prompts unconstrained (S1)](<https://www.sota2.com/research/sota/neutrosophic-evaluation-on-neutrosophic-evaluation-prompts-unconstrained-s1.md>): Neutrosophic Evaluation; Neutrosophic Evaluation Prompts unconstrained (S1).

- [Fake news detection on GossipCop reformed neutral sentiment (test)](<https://www.sota2.com/research/sota/fake-news-detection-on-gossipcop-reformed-neutral-sentiment-test.md>): Fake news detection; GossipCop reformed neutral sentiment (test).

- [Fake news detection on reformed PolitiFact neutral sentiment (test)](<https://www.sota2.com/research/sota/fake-news-detection-on-reformed-politifact-neutral-sentiment-test.md>): Fake news detection; reformed PolitiFact neutral sentiment (test).

- [3D Facial Fitting on Facial scan neutral (test)](<https://www.sota2.com/research/sota/3d-facial-fitting-on-facial-scan-neutral-test.md>): 3D Facial Fitting; Facial scan neutral (test).

- [Abstract Reasoning on PGM Neutral (test)](<https://www.sota2.com/research/sota/abstract-reasoning-on-pgm-neutral-test.md>): Abstract Reasoning; PGM Neutral (test).

- [Abstract Reasoning on PGM Neutral (val)](<https://www.sota2.com/research/sota/abstract-reasoning-on-pgm-neutral-val.md>): Abstract Reasoning; PGM Neutral (val).

- [Continuum Dynamics Prediction on Post Neutron Star Merger (3D) OOD](<https://www.sota2.com/research/sota/continuum-dynamics-prediction-on-post-neutron-star-merger-3d-ood.md>): Continuum Dynamics Prediction; Post Neutron Star Merger (3D) OOD.

- [Online Asset Allocation on NYSE(O) Market Neutral Hedge scenario T = 5,651 days (test)](<https://www.sota2.com/research/sota/online-asset-allocation-on-nyse-o-market-neutral-hedge-scenario-t-5-651-days-test.md>): Online Asset Allocation; NYSE(O) Market Neutral Hedge scenario T = 5,651 days (test).

- [Self-reconstruction on Neutral Dataset](<https://www.sota2.com/research/sota/self-reconstruction-on-neutral-dataset.md>): Self-reconstruction; Neutral Dataset.

- [Gender Neuron Masking on GCGender Neutral](<https://www.sota2.com/research/sota/gender-neuron-masking-on-gcgender-neutral.md>): Gender Neuron Masking; GCGender Neutral.

- [Gender Neuron Masking on InclusiveGender Neutral](<https://www.sota2.com/research/sota/gender-neuron-masking-on-inclusivegender-neutral.md>): Gender Neuron Masking; InclusiveGender Neutral.

- [Gender Controlled Generation on GCGender (Neutral)](<https://www.sota2.com/research/sota/gender-controlled-generation-on-gcgender-neutral.md>): Gender Controlled Generation; GCGender (Neutral).

- [Gender Controlled Generation on InclusiveGender (Neutral)](<https://www.sota2.com/research/sota/gender-controlled-generation-on-inclusivegender-neutral.md>): Gender Controlled Generation; InclusiveGender (Neutral).

- [PDE Solving on Neutron Diff (test)](<https://www.sota2.com/research/sota/pde-solving-on-neutron-diff-test.md>): PDE Solving; Neutron Diff (test).

- [Historical Appearance Restoration on Fangshan Stone Sutra (test)](<https://www.sota2.com/research/sota/historical-appearance-restoration-on-fangshan-stone-sutra-test.md>): Historical Appearance Restoration; Fangshan Stone Sutra (test).

- [Health-aware Top-K Recommendation on Nutrition-all (test)](<https://www.sota2.com/research/sota/health-aware-top-k-recommendation-on-nutrition-all-test.md>): Health-aware Top-K Recommendation; Nutrition-all (test).

- [Health-aware Top-K Recommendation on Nutrition macro only (test)](<https://www.sota2.com/research/sota/health-aware-top-k-recommendation-on-nutrition-macro-only-test.md>): Health-aware Top-K Recommendation; Nutrition macro only (test).

- [Nutrition Estimation on Nutrition5k (test)](<https://www.sota2.com/research/sota/nutrition-estimation-on-nutrition5k-test.md>): Nutrition Estimation; Nutrition5k (test).

- [Logical Reasoning on CLUTRR rob\_train\_disc\_23\_all (test)](<https://www.sota2.com/research/sota/logical-reasoning-on-clutrr-rob_train_disc_23_all-test.md>): Logical Reasoning; CLUTRR rob\_train\_disc\_23\_all (test).

- [Logical Reasoning on CLUTRR rob train irr 23 all (test)](<https://www.sota2.com/research/sota/logical-reasoning-on-clutrr-rob-train-irr-23-all-test.md>): Logical Reasoning; CLUTRR rob train irr 23 all (test).
