# Event-based Video Question Answering on EvQA-Sparse 200 Questions Source: [Event-based Video Question Answering on EvQA-Sparse 200 Questions]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:31:53.760Z Evaluation of model performance on the EvQA-Sparse 200 Questions dataset for Event-based Video Question Answering, reporting accuracy and token usage statistics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Event-based Video Question Answering | | Dataset (including any stated split) | EvQA-Sparse 200 Questions | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Tokens](): Lower is better; unit: SCALAR. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | FRT | 66 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 66 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 65.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 65 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 64.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 63.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 61 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 61 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 60.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 59.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 57.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 57 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 56.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 56.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 56 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 55.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 52.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 52 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 50 | Not recorded | 693f95ea6cfd488761a818ba | | ART | 47.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 46.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 46 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 45.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 45.5 | Not recorded | 693f95ea6cfd488761a818ba | | FRT | 42.5 | Not recorded | 693f95ea6cfd488761a818ba | | ART | 40.5 | Not recorded | 693f95ea6cfd488761a818ba | | ART | 36 | Not recorded | 693f95ea6cfd488761a818ba | | ART | 32.5 | Not recorded | 693f95ea6cfd488761a818ba | ### FRT Accuracy: 66. Result ID: 699854bc5698665ec4b2a3ad. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"24","Model Size":"8B"}. This record does not assert independent reproduction. ### FRT Accuracy: 66. Result ID: 699854bc5698665ec4b2a3ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"24","Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 65.5. Result ID: 699854bc5698665ec4b2a3aa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"8","Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 65. Result ID: 699854bc5698665ec4b2a3ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"24","Model Size":"2B"}. This record does not assert independent reproduction. ### FRT Accuracy: 64.5. Result ID: 699854bc5698665ec4b2a3a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"4","Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 63.5. Result ID: 699854bc5698665ec4b2a3ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"24","Model Size":"4B"}. This record does not assert independent reproduction. ### FRT Accuracy: 61. Result ID: 699854bc5698665ec4b2a3a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"2","Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 61. Result ID: 699854bc5698665ec4b2a3a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"4","Model Size":"8B"}. This record does not assert independent reproduction. ### FRT Accuracy: 60.5. Result ID: 699854bc5698665ec4b2a3a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"8","Model Size":"8B"}. This record does not assert independent reproduction. ### FRT Accuracy: 59.5. Result ID: 699854bc5698665ec4b2a3a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"8","Model Size":"4B"}. This record does not assert independent reproduction. ### FRT Accuracy: 57.5. Result ID: 699854bc5698665ec4b2a3a1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"2","Model Size":"8B"}. This record does not assert independent reproduction. ### FRT Accuracy: 57. Result ID: 699854bc5698665ec4b2a3a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"8","Model Size":"2B"}. This record does not assert independent reproduction. ### FRT Accuracy: 56.5. Result ID: 699854bc5698665ec4b2a39e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"1","Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 56.5. Result ID: 699854bc5698665ec4b2a3a4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"4","Model Size":"4B"}. This record does not assert independent reproduction. ### FRT Accuracy: 56. Result ID: 699854bc5698665ec4b2a3a0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"2","Model Size":"4B"}. This record does not assert independent reproduction. ### FRT Accuracy: 55.5. Result ID: 699854bc5698665ec4b2a3a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"4","Model Size":"2B"}. This record does not assert independent reproduction. ### FRT Accuracy: 52.5. Result ID: 699854bc5698665ec4b2a39a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"0.1","Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 52. Result ID: 699854bc5698665ec4b2a39d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"1","Model Size":"8B"}. This record does not assert independent reproduction. ### FRT Accuracy: 50. Result ID: 699854bc5698665ec4b2a39f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"2","Model Size":"2B"}. This record does not assert independent reproduction. ### ART Accuracy: 47.5. Result ID: 699854bc5698665ec4b2a3b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":null,"Model Size":"32B"}. This record does not assert independent reproduction. ### FRT Accuracy: 46.5. Result ID: 699854bc5698665ec4b2a39b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"1","Model Size":"2B"}. This record does not assert independent reproduction. ### FRT Accuracy: 46. Result ID: 699854bc5698665ec4b2a39c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"1","Model Size":"4B"}. This record does not assert independent reproduction. ### FRT Accuracy: 45.5. Result ID: 699854bc5698665ec4b2a398. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"0.1","Model Size":"4B"}. This record does not assert independent reproduction. ### FRT Accuracy: 45.5. Result ID: 699854bc5698665ec4b2a399. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"0.1","Model Size":"8B"}. This record does not assert independent reproduction. ### FRT Accuracy: 42.5. Result ID: 699854bc5698665ec4b2a397. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":"0.1","Model Size":"2B"}. This record does not assert independent reproduction. ### ART Accuracy: 40.5. Result ID: 699854bc5698665ec4b2a3af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":null,"Model Size":"2B"}. This record does not assert independent reproduction. ### ART Accuracy: 36. Result ID: 699854bc5698665ec4b2a3b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":null,"Model Size":"8B"}. This record does not assert independent reproduction. ### ART Accuracy: 32.5. Result ID: 699854bc5698665ec4b2a3b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"FPS":null,"Model Size":"4B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.