# Next-character prediction on Multilingual NLI Source: [Next-character prediction on Multilingual NLI]() Collection index: [llms.txt]() Data updated: 2026-06-01T10:05:04.448Z Evaluation of language model performance on the Multilingual NLI dataset using Next-character prediction, measured by Character-level accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Next-character prediction | | Dataset (including any stated split) | Multilingual NLI | | Metric | Character-level Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Character-level Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Character-level Accuracy | Result date | Report paper | | --- | --- | --- | --- | | SoftMuon | 63.02 | Not recorded | 6a1d1234dbd7150506f84151 | | Muon | 63.02 | Not recorded | 6a1d1234dbd7150506f84151 | | SoftSignum | 61.36 | Not recorded | 6a1d1234dbd7150506f84151 | | HardSwitchSign | 60.4 | Not recorded | 6a1d1234dbd7150506f84151 | | AdamW | 60.07 | Not recorded | 6a1d1234dbd7150506f84151 | | Signum | 59.71 | Not recorded | 6a1d1234dbd7150506f84151 | | SoftMuon | 57.84 | Not recorded | 6a1d1234dbd7150506f84151 | | Muon | 57.36 | Not recorded | 6a1d1234dbd7150506f84151 | | SoftSignum | 57.05 | Not recorded | 6a1d1234dbd7150506f84151 | | AdamW | 56.91 | Not recorded | 6a1d1234dbd7150506f84151 | | HardSwitchSign | 56.17 | Not recorded | 6a1d1234dbd7150506f84151 | | Signum | 56.17 | Not recorded | 6a1d1234dbd7150506f84151 | | SGD + LinearLR | 49.22 | Not recorded | 6a1d1234dbd7150506f84151 | | SGD | 48.96 | Not recorded | 6a1d1234dbd7150506f84151 | | SGD | 31.4 | Not recorded | 6a1d1234dbd7150506f84151 | | SGD + LinearLR | 27.89 | Not recorded | 6a1d1234dbd7150506f84151 | ### SoftMuon Character-level Accuracy: 63.02. Result ID: 6a1d590afbc373592c171a8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### Muon Character-level Accuracy: 63.02. Result ID: 6a1d590afbc373592c171a8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### SoftSignum Character-level Accuracy: 61.36. Result ID: 6a1d590afbc373592c171a91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### HardSwitchSign Character-level Accuracy: 60.4. Result ID: 6a1d590afbc373592c171a95. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### AdamW Character-level Accuracy: 60.07. Result ID: 6a1d590afbc373592c171a93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### Signum Character-level Accuracy: 59.71. Result ID: 6a1d590afbc373592c171a97. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### SoftMuon Character-level Accuracy: 57.84. Result ID: 6a1d590afbc373592c171a8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### Muon Character-level Accuracy: 57.36. Result ID: 6a1d590afbc373592c171a8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### SoftSignum Character-level Accuracy: 57.05. Result ID: 6a1d590afbc373592c171a90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### AdamW Character-level Accuracy: 56.91. Result ID: 6a1d590afbc373592c171a92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### HardSwitchSign Character-level Accuracy: 56.17. Result ID: 6a1d590afbc373592c171a94. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### Signum Character-level Accuracy: 56.17. Result ID: 6a1d590afbc373592c171a96. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### SGD + LinearLR Character-level Accuracy: 49.22. Result ID: 6a1d590afbc373592c171a9a. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### SGD Character-level Accuracy: 48.96. Result ID: 6a1d590afbc373592c171a98. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"Transformer"}. This record does not assert independent reproduction. ### SGD Character-level Accuracy: 31.4. Result ID: 6a1d590afbc373592c171a99. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. ### SGD + LinearLR Character-level Accuracy: 27.89. Result ID: 6a1d590afbc373592c171a9b. [Reporting paper]() Recorded evaluation configuration: {"Architecture":"LSTM"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.