# MU

Source: [MU](<https://www.sota2.com/research/dataset/mu>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 138. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/mu.md?page=2>): Follow this link to discover more pages.

- [Graph Classification on MUTAG](<https://www.sota2.com/research/sota/graph-classification-on-mutag.md>): Graph Classification; MUTAG.

- [Multi-hop Question Answering on 2WikiMultiHopQA](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa.md>): Multi-hop Question Answering; 2WikiMultiHopQA.

- [Multimodal Understanding on MMMU](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu.md>): Multimodal Understanding; MMMU.

- [Multi-discipline Multimodal Understanding on MMMU](<https://www.sota2.com/research/sota/multi-discipline-multimodal-understanding-on-mmmu.md>): Multi-discipline Multimodal Understanding; MMMU.

- [Multimodal Sentiment Analysis on CMU-MOSEI (test)](<https://www.sota2.com/research/sota/multimodal-sentiment-analysis-on-cmu-mosei-test.md>): Multimodal Sentiment Analysis; CMU-MOSEI (test).

- [Multimodal Sentiment Analysis on CMU-MOSI (test)](<https://www.sota2.com/research/sota/multimodal-sentiment-analysis-on-cmu-mosi-test.md>): Multimodal Sentiment Analysis; CMU-MOSI (test).

- [Audio Watermarking Attribution on MusicCaps](<https://www.sota2.com/research/sota/audio-watermarking-attribution-on-musiccaps.md>): Audio Watermarking Attribution; MusicCaps.

- [Arithmetic Reasoning on MultiArith](<https://www.sota2.com/research/sota/arithmetic-reasoning-on-multiarith.md>): Arithmetic Reasoning; MultiArith.

- [Massive Multi-discipline Multimodal Understanding on MMMU](<https://www.sota2.com/research/sota/massive-multi-discipline-multimodal-understanding-on-mmmu.md>): Massive Multi-discipline Multimodal Understanding; MMMU.

- [Multi-hop Question Answering on 2WikiMultiHopQA (test)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-2wikimultihopqa-test.md>): Multi-hop Question Answering; 2WikiMultiHopQA (test).

- [Graph Classification on MUTAG (test)](<https://www.sota2.com/research/sota/graph-classification-on-mutag-test.md>): Graph Classification; MUTAG (test).

- [Graph Classification on MUTAG (10-fold cross-validation)](<https://www.sota2.com/research/sota/graph-classification-on-mutag-10-fold-cross-validation.md>): Graph Classification; MUTAG (10-fold cross-validation).

- [Multimodal Understanding on MMMU (Efficiency Metrics)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu-efficiency-metrics.md>): Multimodal Understanding; MMMU.

- [Multimodal Reasoning on MMMU](<https://www.sota2.com/research/sota/multimodal-reasoning-on-mmmu.md>): Multimodal Reasoning; MMMU.

- [Multi-discipline Multimodal Understanding on MMMU (val)](<https://www.sota2.com/research/sota/multi-discipline-multimodal-understanding-on-mmmu-val.md>): Multi-discipline Multimodal Understanding; MMMU (val).

- [Multimodal Understanding on MMMU (val)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu-val.md>): Multimodal Understanding; MMMU (val).

- [Multi-hop Question Answering on Musique](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique.md>): Multi-hop Question Answering; Musique.

- [Matrix Multiplication Latency on Synthetic Matrix Multiplication Shapes](<https://www.sota2.com/research/sota/matrix-multiplication-latency-on-synthetic-matrix-multiplication-shapes.md>): Matrix Multiplication Latency; Synthetic Matrix Multiplication Shapes.

- [Linear Regression on Synthetic Multi-task Linear Regression (n=d=50, K=40, epsilon=0.2)](<https://www.sota2.com/research/sota/linear-regression-on-synthetic-multi-task-linear-regression-n-d-50-k-40-epsilon-0-2.md>): Linear Regression; Synthetic Multi-task Linear Regression (n=d=50, K=40, epsilon=0.2).

- [Speaker Verification on VoxCeleb1 with MUSAN noise (test)](<https://www.sota2.com/research/sota/speaker-verification-on-voxceleb1-with-musan-noise-test.md>): Speaker Verification; VoxCeleb1 with MUSAN noise (test).

- [Multimodal Sentiment Analysis on CMU-MOSI](<https://www.sota2.com/research/sota/multimodal-sentiment-analysis-on-cmu-mosi.md>): Multimodal Sentiment Analysis; CMU-MOSI.

- [Image Classification on Vision Multi-task Suite (SUN397, Cars, RESISC45, EuroSAT, SVHN, GTSRB, MNIST, DTD)](<https://www.sota2.com/research/sota/image-classification-on-vision-multi-task-suite-sun397-cars-resisc45-eurosat-svhn-gtsrb-mnist-dtd.md>): Image Classification; Vision Multi-task Suite (SUN397, Cars, RESISC45, EuroSAT, SVHN, GTSRB, MNIST, DTD).

- [Multimodal Reasoning on MMMU Pro (Accuracy)](<https://www.sota2.com/research/sota/multimodal-reasoning-on-mmmu-pro-accuracy.md>): Multimodal Reasoning; MMMU Pro.

- [Graph Classification on IMDB MULTI](<https://www.sota2.com/research/sota/graph-classification-on-imdb-multi.md>): Graph Classification; IMDB MULTI.

- [Multimodal Reasoning on MMMU (val)](<https://www.sota2.com/research/sota/multimodal-reasoning-on-mmmu-val.md>): Multimodal Reasoning; MMMU (val).

- [Video Question Answering on VideoMMMU](<https://www.sota2.com/research/sota/video-question-answering-on-videommmu.md>): Video Question Answering; VideoMMMU.

- [Multi-hop Question Answering on MuSiQue (test)](<https://www.sota2.com/research/sota/multi-hop-question-answering-on-musique-test.md>): Multi-hop Question Answering; MuSiQue (test).

- [Multi-Object Tracking on MOT Simulation](<https://www.sota2.com/research/sota/multi-object-tracking-on-mot-simulation.md>): Multi-Object Tracking; MOT Simulation.

- [Mathematical Reasoning on MultiArith](<https://www.sota2.com/research/sota/mathematical-reasoning-on-multiarith.md>): Mathematical Reasoning; MultiArith.

- [Video Reasoning on VideoMMMU](<https://www.sota2.com/research/sota/video-reasoning-on-videommmu.md>): Video Reasoning; VideoMMMU.

- [Multimodal Machine Translation on Multi30K (test)](<https://www.sota2.com/research/sota/multimodal-machine-translation-on-multi30k-test.md>): Multimodal Machine Translation; Multi30K (test).

- [Arithmetic Reasoning on MultiArith (test)](<https://www.sota2.com/research/sota/arithmetic-reasoning-on-multiarith-test.md>): Arithmetic Reasoning; MultiArith (test).

- [Monocular Depth Estimation on KITTI 80m maximum depth (Eigen)](<https://www.sota2.com/research/sota/monocular-depth-estimation-on-kitti-80m-maximum-depth-eigen.md>): Monocular Depth Estimation; KITTI 80m maximum depth (Eigen).

- [Clustering on Multi-Fashion](<https://www.sota2.com/research/sota/clustering-on-multi-fashion.md>): Clustering; Multi-Fashion.

- [Video Question Answering on NExT-QA Multi-choice](<https://www.sota2.com/research/sota/video-question-answering-on-next-qa-multi-choice.md>): Video Question Answering; NExT-QA Multi-choice.

- [Question Answering on 2WikiMultihopQA (test)](<https://www.sota2.com/research/sota/question-answering-on-2wikimultihopqa-test.md>): Question Answering; 2WikiMultihopQA (test).

- [Multi-Robot Task Planning on F1-F16 fixed-scale simulated instances](<https://www.sota2.com/research/sota/multi-robot-task-planning-on-f1-f16-fixed-scale-simulated-instances.md>): Multi-Robot Task Planning; F1-F16 fixed-scale simulated instances.

- [Multi-image Reasoning on MuirBench](<https://www.sota2.com/research/sota/multi-image-reasoning-on-muirbench.md>): Multi-image Reasoning; MuirBench.

- [Multimodal Understanding on MMMU (test)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu-test.md>): Multimodal Understanding; MMMU (test).

- [Hallucination Reduction on CAA Hallucination Benchmark Multiple-Choice](<https://www.sota2.com/research/sota/hallucination-reduction-on-caa-hallucination-benchmark-multiple-choice.md>): Hallucination reduction; CAA hallucination benchmark multiple-choice.

- [Multimodal Understanding on MMMU (Score)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu-score.md>): Multimodal Understanding; MMMU.

- [Multi-organ segmentation on Synapse multi-organ CT (test)](<https://www.sota2.com/research/sota/multi-organ-segmentation-on-synapse-multi-organ-ct-test.md>): Multi-organ segmentation; Synapse multi-organ CT (test).

- [Multimodal Understanding on MMMU (Accuracy, Average performance retention)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu-accuracy-average-performance-retention.md>): Multimodal Understanding; MMMU.

- [Question Answering on 2WikiMultihopQA (EM/F1/P/R)](<https://www.sota2.com/research/sota/question-answering-on-2wikimultihopqa-em-f1-p-r.md>): Question Answering; 2WikiMultihopQA.

- [Molecular Property Prediction on MoleculeNet MUV (scaffold)](<https://www.sota2.com/research/sota/molecular-property-prediction-on-moleculenet-muv-scaffold.md>): Molecular Property Prediction; MoleculeNet MUV (scaffold).

- [Few-Shot Segmentation on Multiple Datasets](<https://www.sota2.com/research/sota/few-shot-segmentation-on-multiple-datasets.md>): Few-Shot Segmentation; Multiple Datasets.

- [Dialogue State Tracking on MultiWOZ 2.1 (test)](<https://www.sota2.com/research/sota/dialogue-state-tracking-on-multiwoz-2-1-test.md>): Dialogue State Tracking; MultiWOZ 2.1 (test).

- [Offline Reinforcement Learning under Gravity Shift on MuJoCo Ant](<https://www.sota2.com/research/sota/offline-reinforcement-learning-under-gravity-shift-on-mujoco-ant.md>): Offline Reinforcement Learning under Gravity Shift; MuJoCo Ant.

- [Offline Reinforcement Learning under Gravity Shift on MuJoCo Hopper](<https://www.sota2.com/research/sota/offline-reinforcement-learning-under-gravity-shift-on-mujoco-hopper.md>): Offline Reinforcement Learning under Gravity Shift; MuJoCo Hopper.

- [Offline Reinforcement Learning under Gravity Shift on MuJoCo HalfCheetah](<https://www.sota2.com/research/sota/offline-reinforcement-learning-under-gravity-shift-on-mujoco-halfcheetah.md>): Offline Reinforcement Learning under Gravity Shift; MuJoCo HalfCheetah.

- [Job Shop Scheduling Problem on DMU benchmark of JSSP](<https://www.sota2.com/research/sota/job-shop-scheduling-problem-on-dmu-benchmark-of-jssp.md>): Job Shop Scheduling Problem; DMU benchmark of JSSP.

- [Linear Regression on Synthetic Multi-task Dataset d=50, K=20, epsilon=0.2 (test)](<https://www.sota2.com/research/sota/linear-regression-on-synthetic-multi-task-dataset-d-50-k-20-epsilon-0-2-test.md>): Linear Regression; Synthetic Multi-task Dataset d=50, K=20, epsilon=0.2 (test).

- [Multi-task Linear Regression on Synthetic Multi-task Linear Regression (n=d=50, ε=0.2) (test)](<https://www.sota2.com/research/sota/multi-task-linear-regression-on-synthetic-multi-task-linear-regression-n-d-50-0-2-test.md>): Multi-task Linear Regression (Local Parameter Estimation); Synthetic Multi-task Linear Regression (n=d=50, ε=0.2) (test).

- [Multi-task Logistic Regression on Synthetic Multi-task Logistic Regression (n=d=50, epsilon=0.2)](<https://www.sota2.com/research/sota/multi-task-logistic-regression-on-synthetic-multi-task-logistic-regression-n-d-50-epsilon-0-2.md>): Multi-task Logistic Regression; Synthetic Multi-task Logistic Regression (n=d=50, epsilon=0.2).

- [Visual Question Answering on MMMU](<https://www.sota2.com/research/sota/visual-question-answering-on-mmmu.md>): Visual Question Answering; MMMU.

- [Multi-modal Question Answering on MMMU](<https://www.sota2.com/research/sota/multi-modal-question-answering-on-mmmu.md>): Multi-modal Question Answering; MMMU.

- [Dialogue State Tracking on MultiWOZ 2.2 (test)](<https://www.sota2.com/research/sota/dialogue-state-tracking-on-multiwoz-2-2-test.md>): Dialogue State Tracking; MultiWOZ 2.2 (test).

- [Offline Reinforcement Learning on MujoCo halfcheetah](<https://www.sota2.com/research/sota/offline-reinforcement-learning-on-mujoco-halfcheetah.md>): Offline Reinforcement Learning; MujoCo halfcheetah.

- [Multi-task Linear Regression (Global Parameter Estimation) on Synthetic Multi-task Linear Regression (n=d=50, ε=0.2) (test)](<https://www.sota2.com/research/sota/multi-task-linear-regression-global-parameter-estimation-on-synthetic-multi-task-linear-regression-n-d-50-0-2-test.md>): Multi-task Linear Regression (Global Parameter Estimation); Synthetic Multi-task Linear Regression (n=d=50, ε=0.2) (test).

- [Information Retrieval on PIRE multi-chunk](<https://www.sota2.com/research/sota/information-retrieval-on-pire-multi-chunk.md>): Information Retrieval; PIRE multi-chunk.

- [Audio-Visual Question Answering on MUSIC-AVQA 1.0 (test)](<https://www.sota2.com/research/sota/audio-visual-question-answering-on-music-avqa-1-0-test.md>): Audio-Visual Question Answering; MUSIC-AVQA 1.0 (test).

- [Visual Localization on The Extended CMU Seasons (test)](<https://www.sota2.com/research/sota/visual-localization-on-the-extended-cmu-seasons-test.md>): Visual Localization; The Extended CMU Seasons (test).

- [Sentiment Analysis on CMU-MOSEI (test)](<https://www.sota2.com/research/sota/sentiment-analysis-on-cmu-mosei-test.md>): Sentiment Analysis; CMU-MOSEI (test).

- [Multi-hop QA on MuSiQue](<https://www.sota2.com/research/sota/multi-hop-qa-on-musique.md>): Multi-hop QA; MuSiQue.

- [Graph property prediction on MUV](<https://www.sota2.com/research/sota/graph-property-prediction-on-muv.md>): Graph property prediction; MUV.

- [Speech Translation Evaluation on MuST-C](<https://www.sota2.com/research/sota/speech-translation-evaluation-on-must-c.md>): Speech Translation Evaluation; MuST-C.

- [Audio-Visual Question Answering on MUSIC-AVQA (test)](<https://www.sota2.com/research/sota/audio-visual-question-answering-on-music-avqa-test.md>): Audio-Visual Question Answering; MUSIC-AVQA (test).

- [Molecular Property Prediction on MUV (test)](<https://www.sota2.com/research/sota/molecular-property-prediction-on-muv-test.md>): Molecular property prediction; MUV (test).

- [3D Object Detection on MultiCorrupt nuScenes (val)](<https://www.sota2.com/research/sota/3d-object-detection-on-multicorrupt-nuscenes-val.md>): 3D Object Detection; MultiCorrupt nuScenes (val).

- [Machine Unlearning on MUSE Books](<https://www.sota2.com/research/sota/machine-unlearning-on-muse-books.md>): Machine Unlearning; MUSE Books.

- [Dialog State Tracking on MultiWOZ 2.1 (test)](<https://www.sota2.com/research/sota/dialog-state-tracking-on-multiwoz-2-1-test.md>): Dialog State Tracking; MultiWOZ 2.1 (test).

- [Audio Watermark Attribution on MusicCaps (test)](<https://www.sota2.com/research/sota/audio-watermark-attribution-on-musiccaps-test.md>): Audio Watermark Attribution; MusicCaps (test).

- [Audio Watermark Detection on MusicCaps (test)](<https://www.sota2.com/research/sota/audio-watermark-detection-on-musiccaps-test.md>): Audio Watermark Detection; MusicCaps (test).

- [Audio Watermark Detection on MusicCaps balanced (val)](<https://www.sota2.com/research/sota/audio-watermark-detection-on-musiccaps-balanced-val.md>): Audio Watermark Detection; MusicCaps balanced (val).

- [Question Answering on MuSiQue (test)](<https://www.sota2.com/research/sota/question-answering-on-musique-test.md>): Question Answering; MuSiQue (test).

- [Multi-label Classification on Multi-label datasets](<https://www.sota2.com/research/sota/multi-label-classification-on-multi-label-datasets.md>): Multi-label Classification; Multi-label datasets.

- [Multimodal Understanding on MMMU, SEED, OCRBench, VizWiz, ScienceQA, and TextVQA (test)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mmmu-seed-ocrbench-vizwiz-scienceqa-and-textvqa-test.md>): Multimodal Understanding; MMMU, SEED, OCRBench, VizWiz, ScienceQA, and TextVQA Average (test).

- [Question Answering on MuSiQue (EM, F1, R-1)](<https://www.sota2.com/research/sota/question-answering-on-musique-em-f1-r-1.md>): Question Answering; MuSiQue.

- [Robot Manipulation on LIBERO simulation](<https://www.sota2.com/research/sota/robot-manipulation-on-libero-simulation.md>): Robot Manipulation; LIBERO simulation.

- [Multi-discipline Reasoning on MMMU](<https://www.sota2.com/research/sota/multi-discipline-reasoning-on-mmmu.md>): Multi-discipline Reasoning; MMMU.