# Medical Task on Medical Source: [Medical Task on Medical]() Collection index: [llms.txt]() Data updated: 2026-05-21T09:14:30.259Z Evaluation of model performance on the Medical dataset specifically for the Medical Task, measured by Accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Medical Task | | Dataset (including any stated split) | Medical | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Llama-3.2-1B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-1B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-1B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-3B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-3B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-3B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-1.5B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-1.5B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-1.5B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-3B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-3B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-3B-Instruct | 100 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-3B-Instruct | 90 | Not recorded | 6a0e91a1f984739ed6738bfb | | Qwen2.5-1.5B-Instruct | 86.3 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-1B-Instruct | 83.8 | Not recorded | 6a0e91a1f984739ed6738bfb | | Llama-3.2-3B-Instruct | 76.2 | Not recorded | 6a0e91a1f984739ed6738bfb | ### Llama-3.2-1B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-1B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-1B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-3B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-3B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Clean","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-3B-Instruct Accuracy: 100. Result ID: 6a0ecc80fbc373592c0676c1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-3B-Instruct Accuracy: 90. Result ID: 6a0ecc80fbc373592c0676c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct Accuracy: 86.3. Result ID: 6a0ecc80fbc373592c0676be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-1B-Instruct Accuracy: 83.8. Result ID: 6a0ecc80fbc373592c0676b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Eager","Backend":"Inductor"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct Accuracy: 76.2. Result ID: 6a0ecc80fbc373592c0676ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Input Type":"Trigger","Execution Mode":"Compiled","Backend":"Inductor"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.