# MNL

Source: [MNL](<https://www.sota2.com/research/dataset/mnl>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/mnl.md?page=2>): Follow this link to discover more pages.

- [Natural Language Inference on MNLI (matched)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-matched.md>): Natural Language Inference; MNLI (matched).

- [Correlation to Model Behavior Differences on MNLI](<https://www.sota2.com/research/sota/correlation-to-model-behavior-differences-on-mnli.md>): Correlation to Model Behavior Differences; MNLI.

- [Natural Language Inference on MNLI](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli.md>): Natural Language Inference; MNLI.

- [Natural Language Inference on MNLI (mismatched)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-mismatched.md>): Natural Language Inference; MNLI (mismatched).

- [Unconditional Text Generation on EMNLP 2017 WMT News](<https://www.sota2.com/research/sota/unconditional-text-generation-on-emnlp-2017-wmt-news.md>): Unconditional Text Generation; EMNLP 2017 WMT News.

- [Natural Language Inference on MNLI (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-test.md>): Natural Language Inference; MNLI (test).

- [Backdoor Defense on MNLI (test)](<https://www.sota2.com/research/sota/backdoor-defense-on-mnli-test.md>): Backdoor Defense; MNLI (test).

- [Natural Language Inference on MNLI (dev)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-dev.md>): Natural Language Inference; MNLI (dev).

- [Text Classification on MNLI](<https://www.sota2.com/research/sota/text-classification-on-mnli.md>): Text Classification; MNLI.

- [Natural Language Inference on MNLI (Accuracy)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-accuracy.md>): Natural Language Inference; MNLI.

- [Natural Language Inference on NLI Suite (MNLI, QNLI, SNLI, RTE, SICK, SCITAIL) (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-nli-suite-mnli-qnli-snli-rte-sick-scitail-test.md>): Natural Language Inference; NLI benchmarks (MNLI, QNLI, SNLI, RTE, SICK, SCITAIL) (test).

- [Natural Language Inference on MNLI (ECE, BS)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-ece-bs.md>): Natural Language Inference; MNLI.

- [Classification on MNLI (val)](<https://www.sota2.com/research/sota/classification-on-mnli-val.md>): Classification; MNLI (val).

- [General Language Understanding on NLU Suite (Average Accuracy)](<https://www.sota2.com/research/sota/general-language-understanding-on-nlu-suite-average-accuracy.md>): General Language Understanding; NLU Suite (MMLU, SST-2, AGNews, 20News, MNLI, SNLI).

- [Natural Language Inference on CMNLI](<https://www.sota2.com/research/sota/natural-language-inference-on-cmnli.md>): Natural Language Inference; CMNLI.

- [Natural Language Inference on MNLI mm](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-mm.md>): Natural Language Inference; MNLI mm.

- [Probability Calibration on ChaosNLI combined SNLI+MNLI K=3](<https://www.sota2.com/research/sota/probability-calibration-on-chaosnli-combined-snli-plus-mnli-k-3.md>): Probability Calibration; ChaosNLI combined SNLI+MNLI K=3.

- [Natural Language Inference on MNLI (val)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-val.md>): Natural Language Inference; MNLI (val).

- [Natural Language Understanding on GLUE (MNLI, MRPC, QNLI, QQP, SST2) (test)](<https://www.sota2.com/research/sota/natural-language-understanding-on-glue-mnli-mrpc-qnli-qqp-sst2-test.md>): Natural Language Understanding; GLUE MNLI MRPC QNLI QQP SST2 standard (test).

- [Natural Language Inference on MNLI (MNLI Score)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-mnli-score.md>): Natural Language Inference; MNLI.

- [Natural Language Inference on MNLI (Accuracy, F1)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-accuracy-f1.md>): Natural Language Inference; MNLI.

- [Natural Language Inference on MNLI GLUE (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-glue-test.md>): Natural language inference; MNLI GLUE (test).

- [Natural Language Understanding on GLUE MNLI-m](<https://www.sota2.com/research/sota/natural-language-understanding-on-glue-mnli-m.md>): Natural Language Understanding; GLUE MNLI-m.

- [Classification on C3, CMNLI, CHID, BoolQ, WSC, HeSW, PIQA, CoQA, Race-M, Race-H, MMLU, and CMMLU Suite](<https://www.sota2.com/research/sota/classification-on-c3-cmnli-chid-boolq-wsc-hesw-piqa-coqa-race-m-race-h-mmlu-and-cmmlu-suite.md>): Classification; C3, CMNLI, CHID, BoolQ, WSC, HeSW, PIQA, CoQA, Race-M, Race-H, MMLU, CMMLU.

- [Reasoning on CMNLI](<https://www.sota2.com/research/sota/reasoning-on-cmnli.md>): Reasoning; CMNLI.

- [Natural Language Understanding on MRPC, QQP, STS-B, MNLI, QNLI, RTE, SNLI, Sci, SICK, and Twi](<https://www.sota2.com/research/sota/natural-language-understanding-on-mrpc-qqp-sts-b-mnli-qnli-rte-snli-sci-sick-and-twi.md>): Natural Language Understanding; Ten Benchmark Datasets MRPC, QQP, STS-B, MNLI, QNLI, RTE, SNLI, Sci, SICK, Twi.

- [Scientific Paper Retrieval on SCIFULLBENCH ACL-EMNLP (Citations) 1.0](<https://www.sota2.com/research/sota/scientific-paper-retrieval-on-scifullbench-acl-emnlp-citations-1-0.md>): Scientific Paper Retrieval; SCIFULLBENCH ACL-EMNLP (Citations) 1.0.

- [Scientific Paper Retrieval on SCIFULLBENCH ACL-EMNLP (References) 1.0](<https://www.sota2.com/research/sota/scientific-paper-retrieval-on-scifullbench-acl-emnlp-references-1-0.md>): Scientific Paper Retrieval; SCIFULLBENCH ACL-EMNLP (References) 1.0.

- [Natural Language Inference on CMNLI syntactically perturbed](<https://www.sota2.com/research/sota/natural-language-inference-on-cmnli-syntactically-perturbed.md>): Natural Language Inference; CMNLI syntactically perturbed.

- [Classification on MSciNLI, MNLI, PPDB, Yahoo, HellaSwag, CSQA, AQUA Average](<https://www.sota2.com/research/sota/classification-on-mscinli-mnli-ppdb-yahoo-hellaswag-csqa-aqua-average.md>): Classification; MSciNLI, MNLI, PPDB, Yahoo, HellaSwag, CSQA, AQUA Average.

- [Classification on MNLI (ECE, BS)](<https://www.sota2.com/research/sota/classification-on-mnli-ece-bs.md>): Classification; MNLI.

- [Natural Language Inference on MNLI (few-shot/zero-shot)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-few-shot-zero-shot.md>): Natural Language Inference; MNLI few-shot zero-shot.

- [In-Context Learning on 9-dataset Average (SST-5, MNLI, CMSQA, HellaSwag, GeoQ, NL2Bash, Break, MTOP, SMCalFlow) (test)](<https://www.sota2.com/research/sota/in-context-learning-on-9-dataset-average-sst-5-mnli-cmsqa-hellaswag-geoq-nl2bash-break-mtop-smcalflow-test.md>): In-Context Learning; 9-dataset Average (SST-5, MNLI, CMSQA, HellaSwag, GeoQ, NL2Bash, Break, MTOP, SMCalFlow) (test).

- [Natural Language Inference on MNLI Neg](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-neg.md>): Natural Language Inference; MNLI Neg.

- [Structural Bias Evaluation on MNLI](<https://www.sota2.com/research/sota/structural-bias-evaluation-on-mnli.md>): Structural Bias Evaluation; MNLI.

- [Natural Language Inference on MNLI (Accuracy, Normalized Accuracy)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-accuracy-normalized-accuracy.md>): Natural Language Inference; MNLI.

- [Natural Language Inference on MNLI-m](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-m.md>): Natural Language Inference; MNLI-m.

- [Natural Language Inference on MNLI Unknown Bias (in-distribution)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-unknown-bias-in-distribution.md>): Natural Language Inference; MNLI Unknown Bias (in-distribution).

- [Natural Language Inference on MNLI HardSP (challenge)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-hardsp-challenge.md>): Natural Language Inference; MNLI HardSP (challenge).

- [Natural Language Inference on MNLI HardCD (challenge)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-hardcd-challenge.md>): Natural Language Inference; MNLI HardCD (challenge).

- [Natural Language Inference on MNLI Hypothesis-only Bias (in-distribution)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-hypothesis-only-bias-in-distribution.md>): Natural Language Inference; MNLI Hypothesis-only Bias (in-distribution).

- [Natural Language Inference on MNLI Syntactic Bias (in-distribution)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-syntactic-bias-in-distribution.md>): Natural Language Inference; MNLI Syntactic Bias (in-distribution).

- [Natural Language Inference on NLI Suite (SNLI, MNLI, SICK, QNLI, RTE, SciTail) (val)](<https://www.sota2.com/research/sota/natural-language-inference-on-nli-suite-snli-mnli-sick-qnli-rte-scitail-val.md>): Natural Language Inference; NLP Benchmark (SNLI, MNLI, SICK, QNLI, RTE, SciTail) Llama-3-8B (val).

- [Natural Language Inference on MNLI (all combined)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-all-combined.md>): Natural Language Inference; MNLI (all combined).

- [Natural Language Inference on MNLI (test) (SNLI Source)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-test-snli-source.md>): Natural Language Inference; SNLI source: MNLI (test).

- [Natural Language Inference on MNLI-m (dev)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-m-dev.md>): Natural Language Inference; MNLI-m (dev).

- [Natural Language Inference on GLUE (MNLI, QNLI, RTE), SciTail, and SNLI (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-glue-mnli-qnli-rte-scitail-and-snli-test.md>): Natural Language Inference; GLUE (MNLI, QNLI, RTE), SciTail, SNLI (test).

- [Classification on MNLI bias-free (test)](<https://www.sota2.com/research/sota/classification-on-mnli-bias-free-test.md>): Classification; MNLI bias-free (test).

- [Intrinsic Dimension Estimation on MNL6(18) (n=2000)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl6-18-n-2000.md>): Intrinsic Dimension Estimation; MNL6(18) (n=2000).

- [Intrinsic Dimension Estimation on MNL5(12) (n=2000)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl5-12-n-2000.md>): Intrinsic Dimension Estimation; MNL5(12) (n=2000).

- [Intrinsic Dimension Estimation on MNL4(10) (n=2000)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl4-10-n-2000.md>): Intrinsic Dimension Estimation; MNL4(10) (n=2000).

- [Intrinsic Dimension Estimation on MNL3 (d=4, n=2000)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl3-d-4-n-2000.md>): Intrinsic Dimension Estimation; MNL3(4) n=2000.

- [Intrinsic Dimension Estimation on MNL2 (d=4, n=2000)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl2-d-4-n-2000.md>): Intrinsic Dimension Estimation; MNL2 (4) (n=2000).

- [Intrinsic Dimension Estimation on MNL1 (d=6, n=2000)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl1-d-6-n-2000.md>): Intrinsic Dimension Estimation; MNL1(6) (n=2000).

- [Intrinsic Dimension Estimation on MNL6 true dimension d=18 n=500](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl6-true-dimension-d-18-n-500.md>): Intrinsic Dimension Estimation; MNL6 true dimension d=18 n=500.

- [Intrinsic Dimension Estimation on MNL5 true dimension d=12 n=500](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl5-true-dimension-d-12-n-500.md>): Intrinsic Dimension Estimation; MNL5 true dimension d=12 n=500.

- [Intrinsic Dimension Estimation on MNL4 true dimension d=10 n=500](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl4-true-dimension-d-10-n-500.md>): Intrinsic Dimension Estimation; MNL4 true dimension d=10 n=500.

- [Intrinsic Dimension Estimation on MNL3 (d=4, n=500)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl3-d-4-n-500.md>): Intrinsic Dimension Estimation; MNL3 true dimension d=4 n=500.

- [Intrinsic Dimension Estimation on MNL2 true dimension d=4 n=500](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl2-true-dimension-d-4-n-500.md>): Intrinsic Dimension Estimation; MNL2 true dimension d=4 n=500.

- [Intrinsic Dimension Estimation on MNL1 (d=6, n=500)](<https://www.sota2.com/research/sota/intrinsic-dimension-estimation-on-mnl1-d-6-n-500.md>): Intrinsic Dimension Estimation; MNL1 (true dimension d=6), n=500.

- [Hallucination Detection on MNLI (test)](<https://www.sota2.com/research/sota/hallucination-detection-on-mnli-test.md>): Hallucination Detection; MNLI (test).

- [Natural Language Inference on MNLI (Accuracy, ECE, Brier)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-accuracy-ece-brier.md>): Natural Language Inference; MNLI.

- [Performance prediction on MNLI source domains (out-of-domain)](<https://www.sota2.com/research/sota/performance-prediction-on-mnli-source-domains-out-of-domain.md>): Performance prediction; MNLI source domains (out-of-domain).

- [Performance prediction on MNLI source domains (in-domain)](<https://www.sota2.com/research/sota/performance-prediction-on-mnli-source-domains-in-domain.md>): Performance prediction; MNLI source domains (in-domain).

- [Natural Language Inference on MNLI (Accuracy, Confidence, and Error Rates)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-accuracy-confidence-and-error-rates.md>): Natural Language Inference; MNLI.

- [Natural Language Understanding on GLUE (MNLI-m, QNLI, SST-2, MRPC)](<https://www.sota2.com/research/sota/natural-language-understanding-on-glue-mnli-m-qnli-sst-2-mrpc.md>): Natural Language Understanding; GLUE MNLI-m, QNLI, SST-2, MRPC.

- [Ranking correlation with full dataset evaluation on MNLI](<https://www.sota2.com/research/sota/ranking-correlation-with-full-dataset-evaluation-on-mnli.md>): Ranking correlation with full dataset evaluation; MNLI.

- [Natural Language Inference on MNLI matched mismatched (dev)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-matched-mismatched-dev.md>): Natural Language Inference; MNLI matched mismatched (dev).

- [Natural Language Inference on MNLI Matched (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-matched-test.md>): Natural Language Inference; MNLI Matched (test).

- [Natural Language Inference on MNLI mismatched (val)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-mismatched-val.md>): Natural Language Inference; MNLI mismatched (val).

- [NLI on CMNLI (test)](<https://www.sota2.com/research/sota/nli-on-cmnli-test.md>): NLI; CMNLI (test).

- [Sentence Classification on GLUE (MNLI, QQP, QNLI, SST2) (dev)](<https://www.sota2.com/research/sota/sentence-classification-on-glue-mnli-qqp-qnli-sst2-dev.md>): Sentence Classification; GLUE MNLI, QQP, QNLI, SST2 (Matched, Mismatched, dev).

- [Natural Language Inference on MNLI Mismatched Hard (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-mismatched-hard-test.md>): Natural Language Inference; MNLI Mismatched Hard (test).

- [Natural Language Inference on MNLI Matched Hard (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-matched-hard-test.md>): Natural Language Inference; MNLI Matched Hard (test).

- [Natural Language Inference on MNLI GLUE matched mismatched average (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-glue-matched-mismatched-average-test.md>): Natural Language Inference; MNLI GLUE matched mismatched average (test).

- [Natural Language Inference on ChaosMNLI (test)](<https://www.sota2.com/research/sota/natural-language-inference-on-chaosmnli-test.md>): Natural Language Inference; ChaosMNLI (test).

- [Natural Language Understanding on GLUE SST-2, QQP, MNLI-m, MNLI-mm official (test)](<https://www.sota2.com/research/sota/natural-language-understanding-on-glue-sst-2-qqp-mnli-m-mnli-mm-official-test.md>): Natural Language Understanding; GLUE SST-2, QQP, MNLI-m, MNLI-mm official (test).

- [Continual Learning on Comprehensive NLP Benchmark Suite](<https://www.sota2.com/research/sota/continual-learning-on-comprehensive-nlp-benchmark-suite.md>): Continual Learning; MNLI, CB, WiC, COPA, QQP, BoolQA, RTE, IMDB, Yelp, Amazon, SST-2, DBpedia, Agnews, MultiRC, Yahoo.

- [Natural Language Inference on MNLI (m/mm Accuracy)](<https://www.sota2.com/research/sota/natural-language-inference-on-mnli-m-mm-accuracy.md>): Natural Language Inference; MNLI.

- [Zero-shot Natural Language Understanding on CMNLI, HeSW, PIQA, WSC, CoQA, BoolQ, Race-M, Race-H, XSum, and C3 Suite](<https://www.sota2.com/research/sota/zero-shot-natural-language-understanding-on-cmnli-hesw-piqa-wsc-coqa-boolq-race-m-race-h-xsum-and-c3-suite.md>): Zero-shot Natural Language Understanding; NLU Benchmark Suite CMNLI, HeSW, PIQA, WSC, CoQA, BoolQ, Race-M, Race-H, XSum, C3.