# Future Prediction on Authors' (test) Source: [Future Prediction on Authors' (test)]() Collection index: [llms.txt]() Data updated: 2026-03-25T15:02:57.350Z Evaluation of Future Prediction performance on the test split of the Authors' dataset, measured using the Semantic Score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Future Prediction | | Dataset (including any stated split) | Authors' (test) | | Metric | Semantic Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Semantic Score](): Higher is better; unit: SCALAR. ## Recorded results | Method | Semantic Score | Result date | Report paper | | --- | --- | --- | --- | | OUR METHOD | 0.7826 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OUR METHOD | 0.6525 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OpenFlamingo-4B | 0.2025 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OpenFlamingo-3B | 0.2 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OpenFlamingo-4B | 0.1998 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OpenFlamingo-3B | 0.1991 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OpenFlamingo-4B | 0.1878 | Not recorded | 69c36c4d0636e5bf4afc6782 | | OpenFlamingo-3B | 0.181 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2-2B | 0.1694 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2.5-1B | 0.1692 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2-2B | 0.1682 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2.5-1B | 0.1679 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2-1B | 0.1627 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2-1B | 0.1621 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2-2B | 0.1601 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2.5-1B | 0.1596 | Not recorded | 69c36c4d0636e5bf4afc6782 | | InternVL-2-1B | 0.1572 | Not recorded | 69c36c4d0636e5bf4afc6782 | ### OUR METHOD Semantic Score: 0.7826. Result ID: 69c3f91147f34ce924ae0412. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"true"}. This record does not assert independent reproduction. ### OUR METHOD Semantic Score: 0.6525. Result ID: 69c3f91147f34ce924ae0411. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"false"}. This record does not assert independent reproduction. ### OpenFlamingo-4B Semantic Score: 0.2025. Result ID: 69c3f91147f34ce924ae040f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"true","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### OpenFlamingo-3B Semantic Score: 0.2. Result ID: 69c3f91147f34ce924ae040c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"true","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### OpenFlamingo-4B Semantic Score: 0.1998. Result ID: 69c3f91147f34ce924ae0410. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"true","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### OpenFlamingo-3B Semantic Score: 0.1991. Result ID: 69c3f91147f34ce924ae040d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"true","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### OpenFlamingo-4B Semantic Score: 0.1878. Result ID: 69c3f91147f34ce924ae040e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### OpenFlamingo-3B Semantic Score: 0.181. Result ID: 69c3f91147f34ce924ae040b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2-2B Semantic Score: 0.1694. Result ID: 69c3f91147f34ce924ae0407. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"true","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2.5-1B Semantic Score: 0.1692. Result ID: 69c3f91147f34ce924ae0409. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"true","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2-2B Semantic Score: 0.1682. Result ID: 69c3f91147f34ce924ae0406. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"true","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2.5-1B Semantic Score: 0.1679. Result ID: 69c3f91147f34ce924ae040a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"true","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2-1B Semantic Score: 0.1627. Result ID: 69c3f91147f34ce924ae0403. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"true","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2-1B Semantic Score: 0.1621. Result ID: 69c3f91147f34ce924ae0404. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"true","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2-2B Semantic Score: 0.1601. Result ID: 69c3f91147f34ce924ae0405. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2.5-1B Semantic Score: 0.1596. Result ID: 69c3f91147f34ce924ae0408. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### InternVL-2-1B Semantic Score: 0.1572. Result ID: 69c3f91147f34ce924ae0402. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"RGB":"true","Gaze (Text)":"false","Gaze (Image)":"false","Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.