Personality Understanding on Persona-MME 128k context
84.44MemoryGPT-4o
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPT-4oProtocol=Full-context2026.03 | 84.44 | 75.63 | 59.12 | 55.65 | 65.98 | 76.64 | 69.23 | — | |
| PersonaVLM_RLProtocol=RAG2026.03 | 69.28 | 77.7 | 61.5 | 60.26 | 75 | 87.97 | 71.05 | — | |
| InternVL3-38BProtocol=Full-context2026.03 | 67.47 | 71.62 | 64.71 | 58.94 | 65 | 76.69 | 67.18 | — | |
| PersonaVLM_SFTProtocol=RAG2026.03 | 67.47 | 75.68 | 59.36 | 51.66 | 71.67 | 81.95 | 67.18 | — | |
| InternVL3-8BProtocol=Full-context2026.03 | 57.23 | 68.92 | 53.48 | 54.97 | 69.17 | 76.69 | 62.43 | — | |
| Qwen2.5-VL-7BProtocol=RAG2026.03 | 56.63 | 63.51 | 50.27 | 55.63 | 61.67 | 70.68 | 59.01 | — | |
| OneVision-1.5-8BProtocol=Full-context2026.03 | 52.44 | 54.79 | 58.15 | 45.33 | 65.25 | 67.18 | 56.66 | — | |
| Qwen2.5-VL-7BProtocol=Full-context2026.03 | 50.6 | 54.73 | 52.41 | 54.3 | 55.83 | 60.9 | 54.48 | — | |
| GPT-4oProtocol=Full-context2026.03 | — | — | — | — | — | — | — | 45.32 | |
| InternVL3-38BProtocol=Full-context2026.03 | — | — | — | — | — | — | — | 46.56 | |
| InternVL3-8BProtocol=Full-context2026.03 | — | — | — | — | — | — | — | 36.62 | |
| OneVision-1.5-8BProtocol=Full-context2026.03 | — | — | — | — | — | — | — | 14.28 | |
| PersonaVLM_RLProtocol=RAG2026.03 | — | — | — | — | — | — | — | 47.28 | |
| PersonaVLM_SFTProtocol=RAG2026.03 | — | — | — | — | — | — | — | 43.6 | |
| Qwen2.5-VL-7BProtocol=Full-context2026.03 | — | — | — | — | — | — | — | 3.08 | |
| Qwen2.5-VL-7BProtocol=RAG2026.03 | — | — | — | — | — | — | — | 37.88 |