# Visual Reasoning on FOIL 30K captions derived from COCO Source: [Visual Reasoning on FOIL 30K captions derived from COCO]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:54:08.146Z Evaluation of visual reasoning capabilities using the FOIL 30K dataset derived from COCO, focusing on attribute understanding like Object, Count, Color, and Spatial relationships. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Visual Reasoning | | Dataset (including any stated split) | FOIL 30K captions derived from COCO | | Metric | Object Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 10 of 10 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Object Accuracy](): Higher is better; unit: PERCENT. - [Count Accuracy](): Higher is better; unit: PERCENT. - [Color Accuracy](): Higher is better; unit: PERCENT. - [Spatial Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Object Accuracy | Result date | Report paper | | --- | --- | --- | --- | | MID | 84.3 | Not recorded | 68fa59421e209131ce9b570f | | MID | 79.2 | Not recorded | 68fa59421e209131ce9b570f | | InfoNCE | 67.5 | Not recorded | 68fa59421e209131ce9b570f | | CLIP-S | 58.5 | Not recorded | 68fa59421e209131ce9b570f | | InfoNCE | 41.6 | Not recorded | 68fa59421e209131ce9b570f | | SOA | 36.7 | Not recorded | 68fa59421e209131ce9b570f | | SOA | 36.5 | Not recorded | 68fa59421e209131ce9b570f | | CLIP-S | 31.8 | Not recorded | 68fa59421e209131ce9b570f | | CLIP-R-Precision | 23.8 | Not recorded | 68fa59421e209131ce9b570f | | CLIP-R-Precision | 16.8 | Not recorded | 68fa59421e209131ce9b570f | ### MID Object Accuracy: 84.3. Result ID: 698ba62c7a967eddb770515b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-L/14"}. This record does not assert independent reproduction. ### MID Object Accuracy: 79.2. Result ID: 698ba62c7a967eddb7705156. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-B/32"}. This record does not assert independent reproduction. ### InfoNCE Object Accuracy: 67.5. Result ID: 698ba62c7a967eddb770515a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-L/14"}. This record does not assert independent reproduction. ### CLIP-S Object Accuracy: 58.5. Result ID: 698ba62c7a967eddb7705157. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-L/14"}. This record does not assert independent reproduction. ### InfoNCE Object Accuracy: 41.6. Result ID: 698ba62c7a967eddb7705155. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-B/32"}. This record does not assert independent reproduction. ### SOA Object Accuracy: 36.7. Result ID: 698ba62c7a967eddb7705154. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-B/32"}. This record does not assert independent reproduction. ### SOA Object Accuracy: 36.5. Result ID: 698ba62c7a967eddb7705159. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-L/14"}. This record does not assert independent reproduction. ### CLIP-S Object Accuracy: 31.8. Result ID: 698ba62c7a967eddb7705152. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-B/32"}. This record does not assert independent reproduction. ### CLIP-R-Precision Object Accuracy: 23.8. Result ID: 698ba62c7a967eddb7705158. [Reporting paper]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-L/14"}. This record does not assert independent reproduction. ### CLIP-R-Precision Object Accuracy: 16.8. Result ID: 698ba62c7a967eddb7705153. [Reporting paper]() Recorded evaluation configuration: {"CLIP Backbone":"ViT-B/32"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.