# Natural Language Understanding on GLUE (val) - Subset (MNLI, SST-2, CoLA, QNLI, MRPC) Source: [Natural Language Understanding on GLUE (val) - Subset (MNLI, SST-2, CoLA, QNLI, MRPC)]() Collection index: [llms.txt]() Data updated: 2026-05-19T07:32:02.129Z Evaluation of general language understanding capabilities on the GLUE validation set, reporting scores specifically for MNLI, SST-2, CoLA, QNLI, and MRPC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Natural Language Understanding | | Dataset (including any stated split) | GLUE (val) | | Metric | MNLI Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [MNLI Accuracy](): Higher is better; unit: PERCENT. - [SST-2 Accuracy](): Higher is better; unit: PERCENT. - [CoLA Accuracy](): Higher is better; unit: PERCENT. - [QNLI Accuracy](): Higher is better; unit: PERCENT. - [MRPC Accuracy](): Higher is better; unit: PERCENT. - [Average Accuracy (GLUE Subset)](): Higher is better; unit: PERCENT. ## Recorded results | Method | MNLI Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Full | 86.33 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | Full | 86.07 | Not recorded | 69cca6a20636e5bf4afcbc50 | | LoRA+ | 85.81 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | LoRA-Over-MPOR | 85.79 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | PiSSA | 85.75 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | rsLoRA | 85.73 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | LoRA-GA | 85.7 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | DoRA | 85.67 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | LoRA-Over-MPOP | 85.59 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | LoRA-One | 85.49 | Not recorded | 69cca6a20636e5bf4afcbc50 | | AdaLoRA | 85.45 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | LoRA-Over-MPO | 85.42 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | LoRA-GA | 85.36 | Not recorded | 69cca6a20636e5bf4afcbc50 | | CG-LoRA (shift) | 85.36 | Not recorded | 69cca6a20636e5bf4afcbc50 | | LoRA-Over-SVD | 85.33 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | CG-LoRA (no-shift) | 85.32 | Not recorded | 69cca6a20636e5bf4afcbc50 | | LoRA | 85.3 | Not recorded | 6a0bee5fdbc836b87d82c1c1 | | rsLoRA | 85.18 | Not recorded | 69cca6a20636e5bf4afcbc50 | ### Full MNLI Accuracy: 86.33. Result ID: 6a0c11f1fbc373592c01ca18. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### Full MNLI Accuracy: 86.07. Result ID: 69ccdb3447f34ce924b6a109. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"T5-base","Evaluation Protocol":"Finetuned"}. This record does not assert independent reproduction. ### LoRA+ MNLI Accuracy: 85.81. Result ID: 6a0c11f1fbc373592c01ca1c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### LoRA-Over-MPOR MNLI Accuracy: 85.79. Result ID: 6a0c11f1fbc373592c01ca23. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### PiSSA MNLI Accuracy: 85.75. Result ID: 6a0c11f1fbc373592c01ca1a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### rsLoRA MNLI Accuracy: 85.73. Result ID: 6a0c11f1fbc373592c01ca1b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### LoRA-GA MNLI Accuracy: 85.7. Result ID: 6a0c11f1fbc373592c01ca1d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### DoRA MNLI Accuracy: 85.67. Result ID: 6a0c11f1fbc373592c01ca1e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### LoRA-Over-MPOP MNLI Accuracy: 85.59. Result ID: 6a0c11f1fbc373592c01ca22. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### LoRA-One MNLI Accuracy: 85.49. Result ID: 69ccdb3447f34ce924b6a10c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-base","Evaluation Protocol":"Finetuned"}. This record does not assert independent reproduction. ### AdaLoRA MNLI Accuracy: 85.45. Result ID: 6a0c11f1fbc373592c01ca1f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### LoRA-Over-MPO MNLI Accuracy: 85.42. Result ID: 6a0c11f1fbc373592c01ca21. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### LoRA-GA MNLI Accuracy: 85.36. Result ID: 69ccdb3447f34ce924b6a10b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-base","Evaluation Protocol":"Finetuned"}. This record does not assert independent reproduction. ### CG-LoRA (shift) MNLI Accuracy: 85.36. Result ID: 69ccdb3447f34ce924b6a10e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-base","Evaluation Protocol":"Finetuned"}. This record does not assert independent reproduction. ### LoRA-Over-SVD MNLI Accuracy: 85.33. Result ID: 6a0c11f1fbc373592c01ca20. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### CG-LoRA (no-shift) MNLI Accuracy: 85.32. Result ID: 69ccdb3447f34ce924b6a10d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-base","Evaluation Protocol":"Finetuned"}. This record does not assert independent reproduction. ### LoRA MNLI Accuracy: 85.3. Result ID: 6a0c11f1fbc373592c01ca19. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"T5-Base"}. This record does not assert independent reproduction. ### rsLoRA MNLI Accuracy: 85.18. Result ID: 69ccdb3447f34ce924b6a10a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"T5-base","Evaluation Protocol":"Finetuned"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.