# Natural Language Understanding on GLUE (MNLI, RTE, SST-2 Subset) Source: [Natural Language Understanding on GLUE (MNLI, RTE, SST-2 Subset)]() Collection index: [llms.txt]() Data updated: 2026-03-10T06:40:08.528Z Evaluation of model performance across the specific subset of GLUE tasks: MNLI, RTE, and SST-2. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Natural Language Understanding | | Dataset (including any stated split) | GLUE | | Metric | MNLI Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MNLI Accuracy](): Higher is better; unit: PERCENT. - [RTE Accuracy](): Higher is better; unit: PERCENT. - [SST-2 Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | MNLI Accuracy | Result date | Report paper | | --- | --- | --- | --- | | B4G | 56 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 54 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 46 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 46 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 45 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 45 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 44 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 44 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 42 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 40 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 40 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 38 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 38 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 38 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 36 | Not recorded | 69afa5a72d603e6de3e43cf8 | | B4G | 36 | Not recorded | 69afa5a72d603e6de3e43cf8 | ### B4G MNLI Accuracy: 56. Result ID: 69afbbb96dbb7075b9576eea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"QWEN2.5-7B","Task":"style personalization"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 54. Result ID: 69afbbb96dbb7075b9576ee8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"QWEN2.5-7B","Task":"safety enhancement"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 46. Result ID: 69afbbb96dbb7075b9576ee6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GEMMA-2-9B","Task":"style personalization"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 46. Result ID: 69afbbb96dbb7075b9576eeb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"QWEN2.5-7B","Task":"access control"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 45. Result ID: 69afbbb96dbb7075b9576ee4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GEMMA-2-9B","Task":"safety enhancement"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 45. Result ID: 69afbbb96dbb7075b9576ee7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GEMMA-2-9B","Task":"access control"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 44. Result ID: 69afbbb96dbb7075b9576ee5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GEMMA-2-9B","Task":"model identity"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 44. Result ID: 69afbbb96dbb7075b9576ee9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"QWEN2.5-7B","Task":"model identity"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 42. Result ID: 69afbbb96dbb7075b9576eef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA2-13B","Task":"access control"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 40. Result ID: 69afbbb96dbb7075b9576ee2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA3.1-8B","Task":"style personalization"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 40. Result ID: 69afbbb96dbb7075b9576ee3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA3.1-8B","Task":"access control"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 38. Result ID: 69afbbb96dbb7075b9576ee0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA3.1-8B","Task":"safety enhancement"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 38. Result ID: 69afbbb96dbb7075b9576ee1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA3.1-8B","Task":"model identity"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 38. Result ID: 69afbbb96dbb7075b9576eee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA2-13B","Task":"style personalization"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 36. Result ID: 69afbbb96dbb7075b9576eec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA2-13B","Task":"safety enhancement"}. This record does not assert independent reproduction. ### B4G MNLI Accuracy: 36. Result ID: 69afbbb96dbb7075b9576eed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLAMA2-13B","Task":"model identity"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.