Question Answering on Molmo2-Moment (M2M) v1 (test)
79.4AccuracyOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleAnswerer=GPT-4o, Frame Budget=322026.05 | 79.4 | |
| OracleAnswerer=GPT-4o, Frame Budget=82026.05 | 77.9 | |
| OracleAnswerer=Qwen3-VL, Frame Budget=322026.05 | 76.9 | |
| OracleAnswerer=Qwen3-VL, Frame Budget=82026.05 | 68 | |
| ToolMerge + GRPOAnswerer=Qwen3-VL, Frame Budget=322026.05 | 63.4 | |
| SigLIP-QAnswerer=Qwen3-VL, Frame Budget=322026.05 | 63.1 | |
| ToolMerge + GRPOAnswerer=Qwen3-VL, Frame Budget=82026.05 | 63 | |
| ToolMergeAnswerer=Qwen3-VL, Frame Budget=322026.05 | 62.7 | |
| ToolMerge + GRPOAnswerer=GPT-4o, Frame Budget=82026.05 | 62.3 | |
| ToolMerge + GRPOAnswerer=GPT-4o, Frame Budget=322026.05 | 62.3 | |
| SigLIP-QAnswerer=Qwen3-VL, Frame Budget=82026.05 | 61.6 | |
| ToolMergeAnswerer=Qwen3-VL, Frame Budget=82026.05 | 61.6 | |
| SigLIP-QAnswerer=GPT-4o, Frame Budget=322026.05 | 61.1 | |
| ToolMergeAnswerer=GPT-4o, Frame Budget=82026.05 | 60.8 | |
| ToolMergeAnswerer=GPT-4o, Frame Budget=322026.05 | 60.7 | |
| AKSAnswerer=Qwen3-VL, Frame Budget=322026.05 | 60.3 | |
| BOLTAnswerer=GPT-4o, Frame Budget=322026.05 | 59.5 | |
| WFSAnswerer=Qwen3-VL, Frame Budget=322026.05 | 59 | |
| AKSAnswerer=GPT-4o, Frame Budget=322026.05 | 58.2 | |
| BOLTAnswerer=Qwen3-VL, Frame Budget=322026.05 | 58.2 | |
| WFSAnswerer=GPT-4o, Frame Budget=322026.05 | 58.2 | |
| SigLIP-QAnswerer=GPT-4o, Frame Budget=82026.05 | 57.6 | |
| AKSAnswerer=Qwen3-VL, Frame Budget=82026.05 | 57.5 | |
| WFSAnswerer=Qwen3-VL, Frame Budget=82026.05 | 57.5 | |
| WFSAnswerer=GPT-4o, Frame Budget=82026.05 | 56.8 | |
| AKSAnswerer=GPT-4o, Frame Budget=82026.05 | 55 | |
| UniformAnswerer=GPT-4o, Frame Budget=322026.05 | 53.3 | |
| LIFAnswerer=GPT-4o, Frame Budget=322026.05 | 52.8 | |
| BOLTAnswerer=Qwen3-VL, Frame Budget=82026.05 | 52.5 | |
| BOLTAnswerer=GPT-4o, Frame Budget=82026.05 | 52.2 | |
| UniformAnswerer=Qwen3-VL, Frame Budget=322026.05 | 51.9 | |
| LIFAnswerer=Qwen3-VL, Frame Budget=322026.05 | 51.9 | |
| LIFAnswerer=GPT-4o, Frame Budget=82026.05 | 51.5 | |
| LIFAnswerer=Qwen3-VL, Frame Budget=82026.05 | 45 | |
| UniformAnswerer=GPT-4o, Frame Budget=82026.05 | 39.3 | |
| UniformAnswerer=Qwen3-VL, Frame Budget=82026.05 | 35.9 | |
| Blind TextAnswerer=GPT-4o, Frame Budget=02026.05 | 29.9 | |
| Blind TextAnswerer=Qwen3-VL, Frame Budget=02026.05 | 29.8 |