Goal reconstruction on OneStop (New Participant)
71.3QW AccuracyGemini few-shot
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini few-shotPrompting Strategy=few-shot2025.05 | 71.3 | 52.6 | 64.4 | |
| DalEye-LlamaInput Modality=Eye-tracking + Text2025.05 | 67.4 | 55.8 | 55.6 | |
| DalEye-GPTInput Modality=Eye-tracking + Text2025.05 | 61.7 | 55 | 51.4 | |
| Text-only Llama 3.1Input Modality=Text-only2025.05 | 59.1 | 53.5 | 45.4 | |
| Text-only GPT-4o-miniInput Modality=Text-only2025.05 | 56.1 | 45.8 | 45.2 | |
| DalEye-LLaVAInput Modality=Eye-tracking + Text2025.05 | 55.8 | 44.5 | 26.5 | |
| Text-only LLaVA OneVisionInput Modality=Text-only2025.05 | 53.8 | 40.8 | 30.4 | |
| Incorrect Human (different critical span)Input Modality=Human Performance2025.05 | 41.6 | 41 | 21.9 | |
| Gemini zero-shotPrompting Strategy=zero-shot2025.05 | 38.2 | 32.7 | 24.6 | |
| Incorrect Human (same critical span)Input Modality=Human Performance2025.05 | 37 | 34.9 | 29.8 | |
| Arbitrary Gemini 3Prompting Strategy=Arbitrary2025.05 | 31.8 | 34.5 | 19.1 |