# Task success rate on DMV-Bench J=5 1.0 Source: [Task success rate on DMV-Bench J=5 1.0]() Collection index: [llms.txt]() Data updated: 2026-06-29T06:30:42.267Z Evaluation of agent performance on the DMV-Bench J=5 1.0 dataset, measured by the Task Success Rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Task success rate | | Dataset (including any stated split) | DMV-Bench J=5 1.0 | | Metric | Task Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Task Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Task Success Rate | Result date | Report paper | | --- | --- | --- | --- | | DualMem | 82.7 | Not recorded | 6a41fc15206542251d7ccb18 | | DualMem | 81.1 | Not recorded | 6a41fc15206542251d7ccb18 | | M2A | 70.4 | Not recorded | 6a41fc15206542251d7ccb18 | | Caption | 67.3 | Not recorded | 6a41fc15206542251d7ccb18 | | M2A | 65.7 | Not recorded | 6a41fc15206542251d7ccb18 | | Caption | 58.9 | Not recorded | 6a41fc15206542251d7ccb18 | | MMA | 47.7 | Not recorded | 6a41fc15206542251d7ccb18 | | MMA | 46.1 | Not recorded | 6a41fc15206542251d7ccb18 | | WorldMM | 43.5 | Not recorded | 6a41fc15206542251d7ccb18 | | WorldMM | 39.8 | Not recorded | 6a41fc15206542251d7ccb18 | | NoMemory | 0 | Not recorded | 6a41fc15206542251d7ccb18 | | TextOnly | 0 | Not recorded | 6a41fc15206542251d7ccb18 | | NoMemory | 0 | Not recorded | 6a41fc15206542251d7ccb18 | | TextOnly | 0 | Not recorded | 6a41fc15206542251d7ccb18 | ### DualMem Task Success Rate: 82.7. Result ID: 6a42110afbc373592c8662b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. ### DualMem Task Success Rate: 81.1. Result ID: 6a42110afbc373592c8662ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### M2A Task Success Rate: 70.4. Result ID: 6a42110afbc373592c8662aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### Caption Task Success Rate: 67.3. Result ID: 6a42110afbc373592c8662a7. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### M2A Task Success Rate: 65.7. Result ID: 6a42110afbc373592c8662b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. ### Caption Task Success Rate: 58.9. Result ID: 6a42110afbc373592c8662ae. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. ### MMA Task Success Rate: 47.7. Result ID: 6a42110afbc373592c8662a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### MMA Task Success Rate: 46.1. Result ID: 6a42110afbc373592c8662b0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. ### WorldMM Task Success Rate: 43.5. Result ID: 6a42110afbc373592c8662af. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. ### WorldMM Task Success Rate: 39.8. Result ID: 6a42110afbc373592c8662a8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### NoMemory Task Success Rate: 0. Result ID: 6a42110afbc373592c8662a5. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### TextOnly Task Success Rate: 0. Result ID: 6a42110afbc373592c8662a6. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"118–134","Probe counts (nr)":"1,053"}. This record does not assert independent reproduction. ### NoMemory Task Success Rate: 0. Result ID: 6a42110afbc373592c8662ac. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. ### TextOnly Task Success Rate: 0. Result ID: 6a42110afbc373592c8662ad. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"118–134","Probe counts (nr)":"2,762"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.