Memory-Augmented GUI Interaction on MementoGUI-Bench
2.89VAMWorking + Episodic Memory
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Working + Episodic MemoryBackbone=GUI-Owl-1.5-32B2026.05 | 2.89 | 4.31 | 8.3 | |
| Working MemoryBackbone=GUI-Owl-1.5-32B2026.05 | 2.5 | 4.24 | 7.85 | |
| Text Summary MemoryBackbone=GUI-Owl-1.5-32B2026.05 | 2.37 | 3.4 | 3.4 | |
| Direct PromptingBackbone=Gemini-3.1-Pro2026.05 | 2.18 | 2.67 | 2.75 | |
| No HistoryBackbone=GUI-Owl-1.5-32B2026.05 | 2.1 | 2 | 0 | |
| Direct PromptingBackbone=GPT-5.52026.05 | 1.95 | 2 | 2.86 | |
| Working + Episodic MemoryBackbone=MAI-UI-8B2026.05 | 1.88 | 5.36 | 8.13 | |
| Pred. Hist. AllBackbone=GUI-Owl-1.5-32B2026.05 | 1.83 | 2.11 | 4.73 | |
| Working + Episodic MemoryBackbone=GUI-Owl-1.5-8B2026.05 | 1.82 | 4.18 | 7.73 | |
| No HistoryBackbone=MAI-UI-8B2026.05 | 1.81 | 2 | 0 | |
| No HistoryBackbone=UI-Venus-1.5-8B2026.05 | 1.8 | 2 | 0 | |
| Working MemoryBackbone=GUI-Owl-1.5-8B2026.05 | 1.79 | 3.38 | 7.39 | |
| Working MemoryBackbone=MAI-UI-8B2026.05 | 1.76 | 5.13 | 8.18 | |
| Working + Episodic MemoryBackbone=UI-Venus-1.5-8B2026.05 | 1.67 | 5.16 | 7.14 | |
| Text Summary MemoryBackbone=MAI-UI-8B2026.05 | 1.63 | 3 | 3.23 | |
| No HistoryBackbone=GUI-Owl-1.5-8B2026.05 | 1.6 | 2 | 0 | |
| Pred. Hist. AllBackbone=UI-Venus-1.5-8B2026.05 | 1.58 | 2.29 | 5.36 | |
| Text Summary MemoryBackbone=UI-Venus-1.5-8B2026.05 | 1.58 | 3.38 | 3.08 | |
| Pred. Hist. AllBackbone=MAI-UI-8B2026.05 | 1.54 | 2.11 | 7.55 | |
| Text Summary MemoryBackbone=GUI-Owl-1.5-8B2026.05 | 1.51 | 3.05 | 3.1 | |
| Working MemoryBackbone=UI-Venus-1.5-8B2026.05 | 1.41 | 4.63 | 7 | |
| Pred. Hist. AllBackbone=GUI-Owl-1.5-8B2026.05 | 1.04 | 2 | 5.25 |