# Task success rate on DMV-Bench J=10 1.0 Source: [Task success rate on DMV-Bench J=10 1.0]() Collection index: [llms.txt]() Data updated: 2026-06-29T06:30:42.294Z Evaluation of agent performance on the DMV-Bench J=10 1.0 dataset, measured by Task Success Rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Task success rate | | Dataset (including any stated split) | DMV-Bench J=10 1.0 | | Metric | Task Success Rate | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Task Success Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Task Success Rate | Result date | Report paper | | --- | --- | --- | --- | | DualMem | 77.2 | Not recorded | 6a41fc15206542251d7ccb18 | | DualMem | 75.2 | Not recorded | 6a41fc15206542251d7ccb18 | | M2A | 64.8 | Not recorded | 6a41fc15206542251d7ccb18 | | Caption | 63.7 | Not recorded | 6a41fc15206542251d7ccb18 | | M2A | 63 | Not recorded | 6a41fc15206542251d7ccb18 | | Caption | 53.4 | Not recorded | 6a41fc15206542251d7ccb18 | | MMA | 41.7 | Not recorded | 6a41fc15206542251d7ccb18 | | MMA | 41 | Not recorded | 6a41fc15206542251d7ccb18 | | WorldMM | 39.3 | Not recorded | 6a41fc15206542251d7ccb18 | | WorldMM | 32.6 | Not recorded | 6a41fc15206542251d7ccb18 | | NoMemory | 0 | Not recorded | 6a41fc15206542251d7ccb18 | | TextOnly | 0 | Not recorded | 6a41fc15206542251d7ccb18 | | NoMemory | 0 | Not recorded | 6a41fc15206542251d7ccb18 | | TextOnly | 0 | Not recorded | 6a41fc15206542251d7ccb18 | ### DualMem Task Success Rate: 77.2. Result ID: 6a42110afbc373592c8662b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### DualMem Task Success Rate: 75.2. Result ID: 6a42110afbc373592c8662c0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. ### M2A Task Success Rate: 64.8. Result ID: 6a42110afbc373592c8662b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### Caption Task Success Rate: 63.7. Result ID: 6a42110afbc373592c8662b5. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### M2A Task Success Rate: 63. Result ID: 6a42110afbc373592c8662bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. ### Caption Task Success Rate: 53.4. Result ID: 6a42110afbc373592c8662bc. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. ### MMA Task Success Rate: 41.7. Result ID: 6a42110afbc373592c8662be. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. ### MMA Task Success Rate: 41. Result ID: 6a42110afbc373592c8662b7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### WorldMM Task Success Rate: 39.3. Result ID: 6a42110afbc373592c8662bd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. ### WorldMM Task Success Rate: 32.6. Result ID: 6a42110afbc373592c8662b6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### NoMemory Task Success Rate: 0. Result ID: 6a42110afbc373592c8662b3. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### TextOnly Task Success Rate: 0. Result ID: 6a42110afbc373592c8662b4. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Qwen2.5-VL-7B","Steps (stp)":"238–259","Probe counts (nr)":"4,821"}. This record does not assert independent reproduction. ### NoMemory Task Success Rate: 0. Result ID: 6a42110afbc373592c8662ba. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. ### TextOnly Task Success Rate: 0. Result ID: 6a42110afbc373592c8662bb. [Reporting paper]() Recorded evaluation configuration: {"Back-end":"Gemini 2.5 Flash","Steps (stp)":"238–259","Probe counts (nr)":"12,344"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.