# out

Source: [out](<https://www.sota2.com/research/dataset/out>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 69. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/out.md?page=2>): Follow this link to discover more pages.

- [Video Instance Segmentation on YouTube-VIS 2019 (val)](<https://www.sota2.com/research/sota/video-instance-segmentation-on-youtube-vis-2019-val.md>): Video Instance Segmentation; YouTube-VIS 2019 (val).

- [Video Object Segmentation on YouTube-VOS 2018 (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-youtube-vos-2018-val.md>): Video Object Segmentation; YouTube-VOS 2018 (val).

- [Video Instance Segmentation on YouTube-VIS 2021 (val)](<https://www.sota2.com/research/sota/video-instance-segmentation-on-youtube-vis-2021-val.md>): Video Instance Segmentation; YouTube-VIS 2021 (val).

- [Referring Video Object Segmentation on Ref-YouTube-VOS (val)](<https://www.sota2.com/research/sota/referring-video-object-segmentation-on-ref-youtube-vos-val.md>): Referring Video Object Segmentation; Ref-YouTube-VOS (val).

- [Video Object Segmentation on YouTube-VOS 2019 (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-youtube-vos-2019-val.md>): Video Object Segmentation; YouTube-VOS 2019 (val).

- [Out-of-sample random-X Regression on Spiked Covariance Model (d/N=0.9, noise=1)](<https://www.sota2.com/research/sota/out-of-sample-random-x-regression-on-spiked-covariance-model-d-n-0-9-noise-1.md>): Out-of-sample random-X regression; Spiked covariance model d/N = 0.9, noise = 1 synthetic (out-of-sample).

- [Jailbreak Attack on STRONGREJECT (held-out behaviors)](<https://www.sota2.com/research/sota/jailbreak-attack-on-strongreject-held-out-behaviors.md>): Jailbreak Attack; STRONGREJECT (held-out behaviors).

- [Perceived risk prediction on SVM Scenario events (held-out)](<https://www.sota2.com/research/sota/perceived-risk-prediction-on-svm-scenario-events-held-out.md>): Perceived risk prediction; SVM Scenario events (held-out).

- [Domain Generalization on PACS (leave-one-domain-out)](<https://www.sota2.com/research/sota/domain-generalization-on-pacs-leave-one-domain-out.md>): Domain Generalization; PACS (leave-one-domain-out).

- [Video Understanding on Video-MME without subtitles](<https://www.sota2.com/research/sota/video-understanding-on-video-mme-without-subtitles.md>): Video Understanding; Video-MME without subtitles.

- [Referring Video Object Segmentation on Ref-YouTube-VOS](<https://www.sota2.com/research/sota/referring-video-object-segmentation-on-ref-youtube-vos.md>): Referring Video Object Segmentation; Ref-YouTube-VOS.

- [Image Dehazing on SOTS Outdoor](<https://www.sota2.com/research/sota/image-dehazing-on-sots-outdoor.md>): Image Dehazing; SOTS Outdoor.

- [Novel View Synthesis on MipNeRF 360 Outdoor](<https://www.sota2.com/research/sota/novel-view-synthesis-on-mipnerf-360-outdoor.md>): Novel View Synthesis; MipNeRF 360 Outdoor.

- [Video Instance Segmentation on YouTube-VIS 2019](<https://www.sota2.com/research/sota/video-instance-segmentation-on-youtube-vis-2019.md>): Video Instance Segmentation; YouTube-VIS 2019.

- [Video Instance Segmentation on YouTube-VIS (val)](<https://www.sota2.com/research/sota/video-instance-segmentation-on-youtube-vis-val.md>): Video Instance Segmentation; YouTube-VIS (val).

- [Object Recognition on PACS (leave-one-domain-out)](<https://www.sota2.com/research/sota/object-recognition-on-pacs-leave-one-domain-out.md>): Object Recognition; PACS (leave-one-domain-out).

- [Out-of-distribution Detection on CIFAR-100 vs SVHN (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-100-vs-svhn-test.md>): Out-of-distribution Detection; CIFAR-100 SVHN in-distribution out-of-distribution (test).

- [Video Quality Assessment on YouTube-UGC](<https://www.sota2.com/research/sota/video-quality-assessment-on-youtube-ugc.md>): Video Quality Assessment; YouTube-UGC.

- [Regression on Synthetic Spiked Covariance d/N = 0.9 (out-of-sample)](<https://www.sota2.com/research/sota/regression-on-synthetic-spiked-covariance-d-n-0-9-out-of-sample.md>): Regression; Synthetic Spiked Covariance d/N = 0.9 (out-of-sample).

- [Referring Video Segmentation on Ref-YouTube-VOS](<https://www.sota2.com/research/sota/referring-video-segmentation-on-ref-youtube-vos.md>): Referring Video Segmentation; Ref-YouTube-VOS.

- [Video Instance Segmentation on YouTube-VIS 2021](<https://www.sota2.com/research/sota/video-instance-segmentation-on-youtube-vis-2021.md>): Video Instance Segmentation; YouTube-VIS 2021.

- [Option Hedging on S&P 500 options 317 shorter prediction horizons (out-of-sample)](<https://www.sota2.com/research/sota/option-hedging-on-s-and-p-500-options-317-shorter-prediction-horizons-out-of-sample.md>): Option Hedging; S&P 500 options 317 shorter prediction horizons (out-of-sample).

- [Option Pricing on Option pricing data 317 shorter prediction horizons (out-of-sample)](<https://www.sota2.com/research/sota/option-pricing-on-option-pricing-data-317-shorter-prediction-horizons-out-of-sample.md>): Option Pricing; Option pricing data 317 shorter prediction horizons (out-of-sample).

- [Behavior decoding on Makin (held-out sessions)](<https://www.sota2.com/research/sota/behavior-decoding-on-makin-held-out-sessions.md>): Behavior decoding; Makin (held-out sessions).

- [Open Vocabulary Semantic Segmentation on COCO Stuff without background](<https://www.sota2.com/research/sota/open-vocabulary-semantic-segmentation-on-coco-stuff-without-background.md>): Open Vocabulary Semantic Segmentation; COCO Stuff without background.

- [Image Classification on Digits-DG (leave-one-domain-out)](<https://www.sota2.com/research/sota/image-classification-on-digits-dg-leave-one-domain-out.md>): Image Classification; Digits-DG leave-one-domain-out.

- [Image Dehazing on SOTS Outdoor (test)](<https://www.sota2.com/research/sota/image-dehazing-on-sots-outdoor-test.md>): Image Dehazing; SOTS Outdoor (test).

- [Video Question Answering on Video-MME without subtitles](<https://www.sota2.com/research/sota/video-question-answering-on-video-mme-without-subtitles.md>): Video Question Answering; Video-MME without subtitles.

- [Video Object Segmentation on YouTube-VOS (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-youtube-vos-val.md>): Video Object Segmentation; YouTube-VOS (val).

- [Continuous Spatio-Temporal Video Super-Resolution on GoPro 85 (out-of-distribution)](<https://www.sota2.com/research/sota/continuous-spatio-temporal-video-super-resolution-on-gopro-85-out-of-distribution.md>): Continuous spatio-temporal video super-resolution; GoPro 85 (out-of-distribution).

- [Out-of-distribution Detection on CIFAR-10 (ID) vs TinyImageNet (OOD) (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-10-id-vs-tinyimagenet-ood-test.md>): Out-of-distribution Detection; CIFAR-10 (in-distribution) TinyImageNet (out-of-distribution) (test).

- [Image Generation on LSUN Church-Outdoor unconditional (test)](<https://www.sota2.com/research/sota/image-generation-on-lsun-church-outdoor-unconditional-test.md>): Image Generation; LSUN Church-Outdoor unconditional (test).

- [General Reasoning on OOD Performance Suite (ARC-c, GPQA\*, MMLU-Pro) (test)](<https://www.sota2.com/research/sota/general-reasoning-on-ood-performance-suite-arc-c-gpqa-mmlu-pro-test.md>): General Reasoning; Out-of-Distribution Performance Suite (ARC-c, GPQA\*, MMLU-Pro) (test).

- [Out-of-distribution Detection on CIFAR-10 ID vs LSUN OOD (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-10-id-vs-lsun-ood-test.md>): Out-of-distribution Detection; CIFAR-10 in-distribution LSUN out-of-distribution (test).

- [Multi-hop Question Answering on 2WikiMultiHopQA Out-Of-Distribution (OOD)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-out-of-distribution-ood.md>): Multi-hop Question Answering; 2WikiMultiHopQA Out-Of-Distribution (OOD).

- [Open Vocabulary Semantic Segmentation on ADE20K without background](<https://www.sota2.com/research/sota/open-vocabulary-semantic-segmentation-on-ade20k-without-background.md>): Open Vocabulary Semantic Segmentation; ADE20K without background.

- [SIR Dynamics Forecasting on Erdős-Rényi graphs (out-of-sample)](<https://www.sota2.com/research/sota/sir-dynamics-forecasting-on-erd-s-r-nyi-graphs-out-of-sample.md>): SIR dynamics forecasting; Erdős-Rényi graphs (out-of-sample).

- [Open Vocabulary Semantic Segmentation on Cityscapes without background](<https://www.sota2.com/research/sota/open-vocabulary-semantic-segmentation-on-cityscapes-without-background.md>): Open Vocabulary Semantic Segmentation; Cityscapes without background.

- [Open Vocabulary Semantic Segmentation on PASCAL Context 59 without background](<https://www.sota2.com/research/sota/open-vocabulary-semantic-segmentation-on-pascal-context-59-without-background.md>): Open Vocabulary Semantic Segmentation; PASCAL Context 59 without background.

- [Out-of-distribution Detection on CIFAR-100 (ID) vs LSUN (OOD) (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-100-id-vs-lsun-ood-test.md>): Out-of-distribution Detection; CIFAR-100 (in-distribution) / LSUN (out-of-distribution) (test).

- [Diagnosis Prediction on Held-out (test)](<https://www.sota2.com/research/sota/diagnosis-prediction-on-held-out-test.md>): Diagnosis Prediction; Held-out (test).

- [Individual Treatment Effect Estimation on IHDP (out-of-sample)](<https://www.sota2.com/research/sota/individual-treatment-effect-estimation-on-ihdp-out-of-sample.md>): Individual Treatment Effect Estimation; IHDP (out-of-sample).

- [Video Quality Assessment on Xiaomi Redmi Note 13 model 1 (held-out device)](<https://www.sota2.com/research/sota/video-quality-assessment-on-xiaomi-redmi-note-13-model-1-held-out-device.md>): Video Quality Assessment; Xiaomi Redmi Note 13 model 1 (held-out device).

- [Option Hedging on 317 longer prediction horizons (out-of-sample)](<https://www.sota2.com/research/sota/option-hedging-on-317-longer-prediction-horizons-out-of-sample.md>): Option hedging; 317 longer prediction horizons (out-of-sample).

- [Perceived risk prediction on Scenario HB (held out events)](<https://www.sota2.com/research/sota/perceived-risk-prediction-on-scenario-hb-held-out-events.md>): Perceived risk prediction; Scenario HB (held out events).

- [Behavior decoding on Flint (held-out sessions)](<https://www.sota2.com/research/sota/behavior-decoding-on-flint-held-out-sessions.md>): Behavior decoding; Flint (held-out sessions).

- [Image Classification on PACS (Out-of-Domain Evaluation)](<https://www.sota2.com/research/sota/image-classification-on-pacs-out-of-domain-evaluation.md>): Image Classification; PACS (out-of-domain).

- [Jailbreaking Attack Success on STRONGREJECT 40 held-out behaviors](<https://www.sota2.com/research/sota/jailbreaking-attack-success-on-strongreject-40-held-out-behaviors.md>): Jailbreaking Attack Success; STRONGREJECT 40 held-out behaviors.

- [Low-light image enhancement on SDSD-out](<https://www.sota2.com/research/sota/low-light-image-enhancement-on-sdsd-out.md>): Low-light image enhancement; SDSD-out.

- [Ranking on UltraFeedback clean (held-out)](<https://www.sota2.com/research/sota/ranking-on-ultrafeedback-clean-held-out.md>): Ranking; UltraFeedback clean (held-out).

- [Body Composition Segmentation on SAROS held-out (test)](<https://www.sota2.com/research/sota/body-composition-segmentation-on-saros-held-out-test.md>): Body Composition Segmentation; SAROS held-out (test).

- [Defocus Deblurring on DP Dataset Outdoor 1.0 (test)](<https://www.sota2.com/research/sota/defocus-deblurring-on-dp-dataset-outdoor-1-0-test.md>): Defocus Deblurring; DP Dataset Outdoor 1.0 (test).

- [Sequential Recommendation on Amazon Sports and Outdoors (test)](<https://www.sota2.com/research/sota/sequential-recommendation-on-amazon-sports-and-outdoors-test.md>): Sequential Recommendation; Amazon Sports and Outdoors (test).

- [Mathematical Problem Solving on LiveMath held-out (test)](<https://www.sota2.com/research/sota/mathematical-problem-solving-on-livemath-held-out-test.md>): Mathematical Problem Solving; LiveMath held-out (test).

- [Office Application Question Answering on OfficeQA (held-out test)](<https://www.sota2.com/research/sota/office-application-question-answering-on-officeqa-held-out-test.md>): Office Application Question Answering; OfficeQA held-out (test).

- [Spreadsheet Manipulation and Reasoning on SpreadsheetBench held-out (test)](<https://www.sota2.com/research/sota/spreadsheet-manipulation-and-reasoning-on-spreadsheetbench-held-out-test.md>): Spreadsheet Manipulation and Reasoning; SpreadsheetBench held-out (test).

- [Web Search Question Answering on SearchQA (held-out test)](<https://www.sota2.com/research/sota/web-search-question-answering-on-searchqa-held-out-test.md>): Web Search Question Answering; SearchQA held-out (test).

- [Domain Generalization on OfficeHome (leave-one-domain-out)](<https://www.sota2.com/research/sota/domain-generalization-on-officehome-leave-one-domain-out.md>): Domain Generalization; OfficeHome (leave-one-domain-out).

- [Open-domain Question Answering on MusiQue out-of-domain](<https://www.sota2.com/research/sota/open-domain-question-answering-on-musique-out-of-domain.md>): Open-domain Question Answering; MusiQue out-of-domain.

- [Out-of-Distribution Detection on CIFAR-10 (ID) vs Texture (OOD)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-10-id-vs-texture-ood.md>): Out-of-Distribution Detection; CIFAR-10 In-Dist Texture Out-Dist.

- [Out-of-Distribution Detection on CIFAR-100 (ID) vs CIFAR-10 (OOD)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-100-id-vs-cifar-10-ood.md>): Out-of-Distribution Detection; CIFAR100 (in) CIFAR10 (out).

- [Image Dehazing on SOTS outdoor RESIDE (test)](<https://www.sota2.com/research/sota/image-dehazing-on-sots-outdoor-reside-test.md>): Image Dehazing; SOTS outdoor RESIDE (test).

- [Deepfake Detection on GANs Out-of-domain (test)](<https://www.sota2.com/research/sota/deepfake-detection-on-gans-out-of-domain-test.md>): Deepfake Detection; GANs Out-of-domain (test).

- [Deceptive Commitment Prediction on Leave-one-environment-out transfer (held-out fifth)](<https://www.sota2.com/research/sota/deceptive-commitment-prediction-on-leave-one-environment-out-transfer-held-out-fifth.md>): Deceptive commitment prediction; Deceptive commitment prediction Leave-one-environment-out transfer (held-out fifth).

- [Honest commitment prediction on Commitment prediction dataset (Leave-one-environment-out OOD split)](<https://www.sota2.com/research/sota/honest-commitment-prediction-on-commitment-prediction-dataset-leave-one-environment-out-ood-split.md>): Honest commitment prediction; Commitment prediction dataset (Leave-one-environment-out OOD split).

- [User Response Prediction on WorldValuesBench (held-out users)](<https://www.sota2.com/research/sota/user-response-prediction-on-worldvaluesbench-held-out-users.md>): User response prediction; WorldValuesBench (held-out users).

- [Response Prediction on WorldValuesBench (held-out)](<https://www.sota2.com/research/sota/response-prediction-on-worldvaluesbench-held-out.md>): Response Prediction; WorldValuesBench (held-out).

- [Ordinal Prediction on WorldValuesBench (held-out users)](<https://www.sota2.com/research/sota/ordinal-prediction-on-worldvaluesbench-held-out-users.md>): Ordinal Prediction; WorldValuesBench (held-out users).

- [Crash-outcome information retention on Held-out Crash Interaction (test)](<https://www.sota2.com/research/sota/crash-outcome-information-retention-on-held-out-crash-interaction-test.md>): Crash-outcome information retention; Held-out Crash Interaction (test).

- [Token-forcing loss optimization on Random targets Held-out (val)](<https://www.sota2.com/research/sota/token-forcing-loss-optimization-on-random-targets-held-out-val.md>): Token-forcing loss optimization; Random targets Held-out (val).

- [Distributional alignment on out-of-domain (test)](<https://www.sota2.com/research/sota/distributional-alignment-on-out-of-domain-test.md>): Distributional alignment; out-of-domain (test).

- [Image Classification on Office-Home (Leave-One-Domain-Out)](<https://www.sota2.com/research/sota/image-classification-on-office-home-leave-one-domain-out.md>): Image Classification; Office-Home (leave-one-domain-out).

- [Out-of-distribution Detection on SVHN vs CIFAR-10 (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-svhn-vs-cifar-10-test.md>): Out-of-distribution Detection; SVHN CIFAR-10 in-distribution out-of-distribution (test).

- [Domain Generalization on DomainBed (out-of-domain)](<https://www.sota2.com/research/sota/domain-generalization-on-domainbed-out-of-domain.md>): Domain Generalization; DomainBed (out-of-domain).

- [Classification on LungHist700 20% hold-out (test)](<https://www.sota2.com/research/sota/classification-on-lunghist700-20-percent-hold-out-test.md>): Classification; LungHist700 20% hold-out (test).

- [Classification on MSK (Breast) 20% hold-out (test)](<https://www.sota2.com/research/sota/classification-on-msk-breast-20-percent-hold-out-test.md>): Classification; MSK (Breast) 20% hold-out (test).

- [Long-context Question Answering on 2WikiMultiHopQA (Out-Of-Distribution)](<https://www.sota2.com/research/sota/long-context-question-answering-on-2wikimultihopqa-out-of-distribution.md>): Long-context Question Answering; 2WikiMultiHopQA (Out-Of-Distribution).

- [CATE Estimation on IHDP 100 train test splits (out-sample)](<https://www.sota2.com/research/sota/cate-estimation-on-ihdp-100-train-test-splits-out-sample.md>): CATE Estimation; IHDP 100 train test splits (out-sample).

- [Optic Flow Estimation on MVSEC (outdoor\_day1)](<https://www.sota2.com/research/sota/optic-flow-estimation-on-mvsec-outdoor_day1.md>): Optic Flow Estimation; MVSEC (outdoor\_day1).

- [Out-of-distribution Detection on CIFAR-100 (ID) vs TinyImageNet (OOD) (test)](<https://www.sota2.com/research/sota/out-of-distribution-detection-on-cifar-100-id-vs-tinyimagenet-ood-test.md>): Out-of-distribution Detection; CIFAR-100 in-distribution TinyImageNet out-of-distribution (test).
