# True-or-False on Mol-Instructions Source: [True-or-False on Mol-Instructions]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:30:43.414Z Evaluation of models performing True-or-False question answering tasks using the Mol-Instructions dataset, typically measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | True-or-False | | Dataset (including any stated split) | Mol-Instructions | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 13 of 13 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Cuttlefish | 66 | Not recorded | 6982d287a8b01e76cc8e92eb | | Mol-Ins.-Llama-3.1 | 60 | Not recorded | 6982d287a8b01e76cc8e92eb | | Mol-LLama-3.1 | 60 | Not recorded | 6982d287a8b01e76cc8e92eb | | Mol-LLama-2 | 56 | Not recorded | 6982d287a8b01e76cc8e92eb | | Mol-Ins.-Llama-2 | 55 | Not recorded | 6982d287a8b01e76cc8e92eb | | Baize-7B | 48 | Not recorded | 6982d287a8b01e76cc8e92eb | | Galactica-6.7B | 42 | Not recorded | 6982d287a8b01e76cc8e92eb | | MolT5 | 35 | Not recorded | 6982d287a8b01e76cc8e92eb | | Alpaca-7B | 33 | Not recorded | 6982d287a8b01e76cc8e92eb | | Llama-3-8B | 27 | Not recorded | 6982d287a8b01e76cc8e92eb | | Qwen-2.5-7B | 21 | Not recorded | 6982d287a8b01e76cc8e92eb | | ChatGLM-6B | 18 | Not recorded | 6982d287a8b01e76cc8e92eb | | Vicuna-v1.5-13B | 12 | Not recorded | 6982d287a8b01e76cc8e92eb | ### Cuttlefish Accuracy: 66. Result ID: 699609d45698665ec441b6bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Mol-Ins.-Llama-3.1 Accuracy: 60. Result ID: 699609d45698665ec441b6b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Mol-LLama-3.1 Accuracy: 60. Result ID: 699609d45698665ec441b6bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Mol-LLama-2 Accuracy: 56. Result ID: 699609d45698665ec441b6ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Mol-Ins.-Llama-2 Accuracy: 55. Result ID: 699609d45698665ec441b6b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Baize-7B Accuracy: 48. Result ID: 699609d45698665ec441b6b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Galactica-6.7B Accuracy: 42. Result ID: 699609d45698665ec441b6b5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MolT5 Accuracy: 35. Result ID: 699609d45698665ec441b6b7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Alpaca-7B Accuracy: 33. Result ID: 699609d45698665ec441b6b0. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Llama-3-8B Accuracy: 27. Result ID: 699609d45698665ec441b6b3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Qwen-2.5-7B Accuracy: 21. Result ID: 699609d45698665ec441b6b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ChatGLM-6B Accuracy: 18. Result ID: 699609d45698665ec441b6b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Vicuna-v1.5-13B Accuracy: 12. Result ID: 699609d45698665ec441b6b4. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.