# SOTA2 Research: benchmarks

Source: [SOTA2 Research: benchmarks](<https://www.sota2.com/research/benchmarks>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

# SOTA2 Research: benchmarks

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Pages

- [Language Modeling on WikiText2](<https://www.sota2.com/research/sota/language-modeling-on-wikitext2.md>): Language Modeling; WikiText2. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on CIFAR-100 (test)](<https://www.sota2.com/research/sota/image-classification-on-cifar-100-test.md>): Image Classification; CIFAR-100 (test). Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on CIFAR-10 (test)](<https://www.sota2.com/research/sota/image-classification-on-cifar-10-test.md>): Image Classification; CIFAR-10 (test). Read the exact metric, direction, date and evaluation configuration.

- [Semantic Segmentation on ADE20K (val)](<https://www.sota2.com/research/sota/semantic-segmentation-on-ade20k-val.md>): Semantic Segmentation; ADE20K (val). Read the exact metric, direction, date and evaluation configuration.

- [Object Detection on COCO 2017 (val)](<https://www.sota2.com/research/sota/object-detection-on-coco-2017-val.md>): Object Detection; COCO 2017 (val). Read the exact metric, direction, date and evaluation configuration.

- [Language Modeling on WikiText-2](<https://www.sota2.com/research/sota/language-modeling-on-wikitext-2.md>): Language Modeling; WikiText-2. Read the exact metric, direction, date and evaluation configuration.

- [Language Modeling on WikiText-2 (test)](<https://www.sota2.com/research/sota/language-modeling-on-wikitext-2-test.md>): Language Modeling; WikiText-2 (test). Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet-1K 1.0 (val)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-1-0-val.md>): Image Classification; ImageNet-1K 1.0 (val). Read the exact metric, direction, date and evaluation configuration.

- [Semantic Segmentation on PASCAL VOC 2012 (val)](<https://www.sota2.com/research/sota/semantic-segmentation-on-pascal-voc-2012-val.md>): Semantic Segmentation; PASCAL VOC 2012 (val). Read the exact metric, direction, date and evaluation configuration.

- [Object Hallucination Evaluation on POPE](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope.md>): Object Hallucination Evaluation; POPE. Read the exact metric, direction, date and evaluation configuration.

- [Commonsense Reasoning on HellaSwag](<https://www.sota2.com/research/sota/commonsense-reasoning-on-hellaswag.md>): Commonsense Reasoning; HellaSwag. Read the exact metric, direction, date and evaluation configuration.

- [Visual Question Answering on VizWiz](<https://www.sota2.com/research/sota/visual-question-answering-on-vizwiz.md>): Visual Question Answering; VizWiz. Read the exact metric, direction, date and evaluation configuration.

- [Language Modeling on C4 (Perplexity)](<https://www.sota2.com/research/sota/language-modeling-on-c4-perplexity.md>): Language Modeling; C4. Read the exact metric, direction, date and evaluation configuration.

- [Commonsense Reasoning on WinoGrande](<https://www.sota2.com/research/sota/commonsense-reasoning-on-winogrande.md>): Commonsense Reasoning; WinoGrande. Read the exact metric, direction, date and evaluation configuration.

- [Language Modeling on C4](<https://www.sota2.com/research/sota/language-modeling-on-c4.md>): Language Modeling; C4. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet 1k (val)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-val.md>): Image Classification; ImageNet 1k (val). Read the exact metric, direction, date and evaluation configuration.

- [Semantic Segmentation on PASCAL VOC 2012 (test)](<https://www.sota2.com/research/sota/semantic-segmentation-on-pascal-voc-2012-test.md>): Semantic Segmentation; PASCAL VOC 2012 (test). Read the exact metric, direction, date and evaluation configuration.

- [Visual Question Answering on TextVQA](<https://www.sota2.com/research/sota/visual-question-answering-on-textvqa.md>): Visual Question Answering; TextVQA. Read the exact metric, direction, date and evaluation configuration.

- [Automatic Speech Recognition on LibriSpeech (test-other)](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-librispeech-test-other.md>): Automatic Speech Recognition; LibriSpeech (test-other). Read the exact metric, direction, date and evaluation configuration.

- [Visual Question Answering on GQA](<https://www.sota2.com/research/sota/visual-question-answering-on-gqa.md>): Visual Question Answering; GQA. Read the exact metric, direction, date and evaluation configuration.

- [Visual Question Answering on VQA v2](<https://www.sota2.com/research/sota/visual-question-answering-on-vqa-v2.md>): Visual Question Answering; VQA v2. Read the exact metric, direction, date and evaluation configuration.

- [Mathematical Reasoning on GSM8K](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm8k.md>): Mathematical Reasoning; GSM8K. Read the exact metric, direction, date and evaluation configuration.

- [Automatic Speech Recognition on LibriSpeech clean (test)](<https://www.sota2.com/research/sota/automatic-speech-recognition-on-librispeech-clean-test.md>): Automatic Speech Recognition; LibriSpeech clean (test). Read the exact metric, direction, date and evaluation configuration.

- [Graph Classification on PROTEINS](<https://www.sota2.com/research/sota/graph-classification-on-proteins.md>): Graph Classification; PROTEINS. Read the exact metric, direction, date and evaluation configuration.

- [Instance Segmentation on COCO 2017 (val)](<https://www.sota2.com/research/sota/instance-segmentation-on-coco-2017-val.md>): Instance Segmentation; COCO 2017 (val). Read the exact metric, direction, date and evaluation configuration.

- [Person Re-identification on Market1501 (test)](<https://www.sota2.com/research/sota/person-re-identification-on-market1501-test.md>): Person Re-identification; Market1501 (test). Read the exact metric, direction, date and evaluation configuration.

- [Semantic Segmentation on Cityscapes (test)](<https://www.sota2.com/research/sota/semantic-segmentation-on-cityscapes-test.md>): Semantic Segmentation; Cityscapes (test). Read the exact metric, direction, date and evaluation configuration.

- [Video Object Segmentation on DAVIS 2017 (val)](<https://www.sota2.com/research/sota/video-object-segmentation-on-davis-2017-val.md>): Video Object Segmentation; DAVIS 2017 (val). Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet-1K (Top-1 Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-top-1-accuracy.md>): Image Classification; ImageNet-1K. Read the exact metric, direction, date and evaluation configuration.

- [Object Detection on COCO (test-dev)](<https://www.sota2.com/research/sota/object-detection-on-coco-test-dev.md>): Object Detection; COCO (test-dev). Read the exact metric, direction, date and evaluation configuration.

- [Language Modeling on PTB](<https://www.sota2.com/research/sota/language-modeling-on-ptb.md>): Language Modeling; PTB. Read the exact metric, direction, date and evaluation configuration.

- [Graph Classification on MUTAG](<https://www.sota2.com/research/sota/graph-classification-on-mutag.md>): Graph Classification; MUTAG. Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Cora](<https://www.sota2.com/research/sota/node-classification-on-cora.md>): Node Classification; Cora. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet (val)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-val.md>): Image Classification; ImageNet (val). Read the exact metric, direction, date and evaluation configuration.

- [Classification on ImageNet-1K 1.0 (val)](<https://www.sota2.com/research/sota/classification-on-imagenet-1k-1-0-val.md>): Classification; ImageNet-1K 1.0 (val). Read the exact metric, direction, date and evaluation configuration.

- [Person Re-identification on Market 1501](<https://www.sota2.com/research/sota/person-re-identification-on-market-1501.md>): Person Re-identification; Market 1501. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on CIFAR-10 (test) (Accuracy and Sparsity)](<https://www.sota2.com/research/sota/image-classification-on-cifar-10-test-accuracy-and-sparsity.md>): Image Classification; CIFAR-10 (test). Read the exact metric, direction, date and evaluation configuration.

- [Code Generation on HumanEval](<https://www.sota2.com/research/sota/code-generation-on-humaneval.md>): Code Generation; HumanEval. Read the exact metric, direction, date and evaluation configuration.

- [Multiple Object Tracking on MOT17 (test)](<https://www.sota2.com/research/sota/multiple-object-tracking-on-mot17-test.md>): Multiple Object Tracking; MOT17 (test). Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Citeseer](<https://www.sota2.com/research/sota/node-classification-on-citeseer.md>): Node Classification; Citeseer. Read the exact metric, direction, date and evaluation configuration.

- [Semantic Segmentation on S3DIS (Area 5)](<https://www.sota2.com/research/sota/semantic-segmentation-on-s3dis-area-5.md>): Semantic Segmentation; S3DIS (Area 5). Read the exact metric, direction, date and evaluation configuration.

- [Semantic Segmentation on ADE20K](<https://www.sota2.com/research/sota/semantic-segmentation-on-ade20k.md>): Semantic Segmentation; ADE20K. Read the exact metric, direction, date and evaluation configuration.

- [Robot Manipulation on LIBERO](<https://www.sota2.com/research/sota/robot-manipulation-on-libero.md>): Robot Manipulation; LIBERO. Read the exact metric, direction, date and evaluation configuration.

- [Person Re-identification on Duke MTMC-reID (test)](<https://www.sota2.com/research/sota/person-re-identification-on-duke-mtmc-reid-test.md>): Person Re-identification; Duke MTMC-reID (test). Read the exact metric, direction, date and evaluation configuration.

- [Class-conditional Image Generation on ImageNet 256x256](<https://www.sota2.com/research/sota/class-conditional-image-generation-on-imagenet-256x256.md>): Class-conditional Image Generation; ImageNet 256x256. Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Citeseer (test)](<https://www.sota2.com/research/sota/node-classification-on-citeseer-test.md>): Node Classification; Citeseer (test). Read the exact metric, direction, date and evaluation configuration.

- [Text-based Visual Question Answering on TextVQA (Accuracy)](<https://www.sota2.com/research/sota/text-based-visual-question-answering-on-textvqa-accuracy.md>): Text-based Visual Question Answering; TextVQA. Read the exact metric, direction, date and evaluation configuration.

- [3D Object Detection on nuScenes (val)](<https://www.sota2.com/research/sota/3d-object-detection-on-nuscenes-val.md>): 3D Object Detection; nuScenes (val). Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on CIFAR-10 (Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-cifar-10-accuracy.md>): Image Classification; CIFAR-10. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet 1K (val) (Standard Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-val-standard-accuracy.md>): Image Classification; ImageNet 1K (val). Read the exact metric, direction, date and evaluation configuration.

- [Mathematical Reasoning on GSM8K (test) (Accuracy)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-gsm8k-test-accuracy.md>): Mathematical Reasoning; GSM8K (test). Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Cora (test)](<https://www.sota2.com/research/sota/node-classification-on-cora-test.md>): Node classification; Cora (test). Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet 1k (test)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-test.md>): Image Classification; ImageNet 1k (test). Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Chameleon](<https://www.sota2.com/research/sota/node-classification-on-chameleon.md>): Node Classification; Chameleon. Read the exact metric, direction, date and evaluation configuration.

- [3D Object Detection on nuScenes (test)](<https://www.sota2.com/research/sota/3d-object-detection-on-nuscenes-test.md>): 3D Object Detection; nuScenes (test). Read the exact metric, direction, date and evaluation configuration.

- [Mathematical Reasoning on MATH500 (test)](<https://www.sota2.com/research/sota/mathematical-reasoning-on-math500-test.md>): Mathematical Reasoning; MATH500 (test). Read the exact metric, direction, date and evaluation configuration.

- [Science Question Answering on ScienceQA](<https://www.sota2.com/research/sota/science-question-answering-on-scienceqa.md>): Science Question Answering; ScienceQA. Read the exact metric, direction, date and evaluation configuration.

- [Text-to-Image Generation on GenEval (Compositional Metrics Subset)](<https://www.sota2.com/research/sota/text-to-image-generation-on-geneval-compositional-metrics-subset.md>): Text-to-Image Generation; GenEval. Read the exact metric, direction, date and evaluation configuration.

- [Multivariate Forecasting on ETTh1](<https://www.sota2.com/research/sota/multivariate-forecasting-on-etth1.md>): Multivariate Forecasting; ETTh1. Read the exact metric, direction, date and evaluation configuration.

- [Language Modeling on C4 (val)](<https://www.sota2.com/research/sota/language-modeling-on-c4-val.md>): Language Modeling; C4 (val). Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on CIFAR-10 (test) (Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-cifar-10-test-accuracy.md>): Image Classification; CIFAR-10 (test). Read the exact metric, direction, date and evaluation configuration.

- [Question Answering on ARC Challenge](<https://www.sota2.com/research/sota/question-answering-on-arc-challenge.md>): Question Answering; ARC Challenge. Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Pubmed](<https://www.sota2.com/research/sota/node-classification-on-pubmed.md>): Node Classification; Pubmed. Read the exact metric, direction, date and evaluation configuration.

- [Multimodal Evaluation on MME](<https://www.sota2.com/research/sota/multimodal-evaluation-on-mme.md>): Multimodal Evaluation; MME. Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Cornell](<https://www.sota2.com/research/sota/node-classification-on-cornell.md>): Node Classification; Cornell. Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Wisconsin](<https://www.sota2.com/research/sota/node-classification-on-wisconsin.md>): Node Classification; Wisconsin. Read the exact metric, direction, date and evaluation configuration.

- [Commonsense Reasoning on HellaSwag (Accuracy)](<https://www.sota2.com/research/sota/commonsense-reasoning-on-hellaswag-accuracy.md>): Commonsense Reasoning; HellaSwag. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on MNIST (test)](<https://www.sota2.com/research/sota/image-classification-on-mnist-test.md>): Image Classification; MNIST (test). Read the exact metric, direction, date and evaluation configuration.

- [Multimodal Understanding on MMBench](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmbench.md>): Multimodal Understanding; MMBench. Read the exact metric, direction, date and evaluation configuration.

- [Composed Image Retrieval on CIRR (test)](<https://www.sota2.com/research/sota/composed-image-retrieval-on-cirr-test.md>): Composed Image Retrieval; CIRR (test). Read the exact metric, direction, date and evaluation configuration.

- [Mathematical Reasoning on MATH](<https://www.sota2.com/research/sota/mathematical-reasoning-on-math.md>): Mathematical Reasoning; MATH. Read the exact metric, direction, date and evaluation configuration.

- [Multi-task Language Understanding on MMLU](<https://www.sota2.com/research/sota/multi-task-language-understanding-on-mmlu.md>): Multi-task Language Understanding; MMLU. Read the exact metric, direction, date and evaluation configuration.

- [Image Super-Resolution on Manga109 (PSNR, SSIM)](<https://www.sota2.com/research/sota/image-super-resolution-on-manga109-psnr-ssim.md>): Image Super-Resolution; Manga109. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on ImageNet-1K (val) (Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-imagenet-1k-val-accuracy.md>): Image Classification; ImageNet-1K (val). Read the exact metric, direction, date and evaluation configuration.

- [Time Series Forecasting on ETTh1](<https://www.sota2.com/research/sota/time-series-forecasting-on-etth1.md>): Time Series Forecasting; ETTh1. Read the exact metric, direction, date and evaluation configuration.

- [Image Classification on Tiny-ImageNet (test)](<https://www.sota2.com/research/sota/image-classification-on-tiny-imagenet-test.md>): Image Classification; Tiny-ImageNet (test). Read the exact metric, direction, date and evaluation configuration.

- [Node Classification on Texas](<https://www.sota2.com/research/sota/node-classification-on-texas.md>): Node Classification; Texas. Read the exact metric, direction, date and evaluation configuration.

- [Instruction Following on IFEval](<https://www.sota2.com/research/sota/instruction-following-on-ifeval.md>): Instruction Following; IFEval. Read the exact metric, direction, date and evaluation configuration.

- [Super-Resolution on Set5 (PSNR & SSIM)](<https://www.sota2.com/research/sota/super-resolution-on-set5-psnr-and-ssim.md>): Super-Resolution; Set5. Read the exact metric, direction, date and evaluation configuration.

- [Language Understanding on MMLU (Accuracy)](<https://www.sota2.com/research/sota/language-understanding-on-mmlu-accuracy.md>): Language Understanding; MMLU. Read the exact metric, direction, date and evaluation configuration.

Page 1 of 3865. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/llms.txt?resource=benchmarks&page=2>): Follow this link to discover more pages.