# Medical Visual Question Answering on DeepTumorVQA Source: [Medical Visual Question Answering on DeepTumorVQA]() Collection index: [llms.txt]() Data updated: 2026-03-27T12:51:52.184Z Evaluation of model performance on medical visual question answering capabilities using the DeepTumorVQA dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Medical Visual Question Answering | | Dataset (including any stated split) | DeepTumorVQA | | Metric | Average Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 13 of 13 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Average Score](): Higher is better; unit: PERCENT. - [Accuracy](): Higher is better; unit: PERCENT. - [MRA Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Average Score | Result date | Report paper | | --- | --- | --- | --- | | Photon | 68.6 | Not recorded | 69c60efd0636e5bf4afc84c6 | | RadFM | 66.2 | Not recorded | 69c60efd0636e5bf4afc84c6 | | M3D-P3 | 63.2 | Not recorded | 69c60efd0636e5bf4afc84c6 | | CT-CHAT | 62.8 | Not recorded | 69c60efd0636e5bf4afc84c6 | | M3D-L2 | 62.6 | Not recorded | 69c60efd0636e5bf4afc84c6 | | Photon | 61.9 | Not recorded | 69c60efd0636e5bf4afc84c6 | | RadFM | 55.5 | Not recorded | 69c60efd0636e5bf4afc84c6 | | CT-CHAT | 49.7 | Not recorded | 69c60efd0636e5bf4afc84c6 | | M3D-P3 | 49.3 | Not recorded | 69c60efd0636e5bf4afc84c6 | | M3D-L2 | 48.9 | Not recorded | 69c60efd0636e5bf4afc84c6 | | Merlin | 47.8 | Not recorded | 69c60efd0636e5bf4afc84c6 | | Merlin | 44 | Not recorded | 69c60efd0636e5bf4afc84c6 | | Rand | 36.9 | Not recorded | 69c60efd0636e5bf4afc84c6 | ### Photon Average Score: 68.6. Result ID: 69c67d5847f34ce924b06d8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice","Model Parameters":"3B"}. This record does not assert independent reproduction. ### RadFM Average Score: 66.2. Result ID: 69c67d5847f34ce924b06d88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice","Model Parameters":"13B"}. This record does not assert independent reproduction. ### M3D-P3 Average Score: 63.2. Result ID: 69c67d5847f34ce924b06d84. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice","Model Parameters":"4B"}. This record does not assert independent reproduction. ### CT-CHAT Average Score: 62.8. Result ID: 69c67d5847f34ce924b06d86. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice","Model Parameters":"7B"}. This record does not assert independent reproduction. ### M3D-L2 Average Score: 62.6. Result ID: 69c67d5847f34ce924b06d82. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice","Model Parameters":"7B"}. This record does not assert independent reproduction. ### Photon Average Score: 61.9. Result ID: 69c67d5847f34ce924b06d8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Free-text","Model Parameters":"3B"}. This record does not assert independent reproduction. ### RadFM Average Score: 55.5. Result ID: 69c67d5847f34ce924b06d89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Free-text","Model Parameters":"13B"}. This record does not assert independent reproduction. ### CT-CHAT Average Score: 49.7. Result ID: 69c67d5847f34ce924b06d87. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Mode":"Free-text","Model Parameters":"7B"}. This record does not assert independent reproduction. ### M3D-P3 Average Score: 49.3. Result ID: 69c67d5847f34ce924b06d85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Free-text","Model Parameters":"4B"}. This record does not assert independent reproduction. ### M3D-L2 Average Score: 48.9. Result ID: 69c67d5847f34ce924b06d83. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Mode":"Free-text","Model Parameters":"7B"}. This record does not assert independent reproduction. ### Merlin Average Score: 47.8. Result ID: 69c67d5847f34ce924b06d81. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Mode":"Free-text","Model Parameters":"7B"}. This record does not assert independent reproduction. ### Merlin Average Score: 44. Result ID: 69c67d5847f34ce924b06d80. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice","Model Parameters":"7B"}. This record does not assert independent reproduction. ### Rand Average Score: 36.9. Result ID: 69c67d5847f34ce924b06d7f. [Reporting paper]() Recorded evaluation configuration: {"Evaluation Mode":"Multi-choice"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.