Multimodal Policy Internalization on ClevrPolicy-T N=6 (test)
77.8Accuracy (N=6)TriMPI w/ PoRo-DAPO
Evaluation results
| Method | Links | |
|---|---|---|
| TriMPI w/ PoRo-DAPOCPT=true, SFT=true, RL=true, RL Steps=90*|75*|50, PolicyRollout=true2025.10 | 77.8 | |
| CoT SFT + DAPOCPT=false, SFT=true, RL=true, RL Steps=104|85*|502025.10 | 67.6 | |
| TriMPI w/ DAPOCPT=true, SFT=true, RL=true, RL Steps=70*|70*|50, PolicyRollout=false2025.10 | 65.85 | |
| TriMPI w/ PoRo-GRPOCPT=true, SFT=true, RL=true, RL Steps=104|104|50, PolicyRollout=true2025.10 | 65.85 | |
| TriMPI w/ GRPOCPT=true, SFT=true, RL=true, RL Steps=104|104|50, PolicyRollout=false2025.10 | 55.9 | |
| CoT SFT + GRPOCPT=false, SFT=true, RL=true, RL Steps=104|104|502025.10 | 47.05 | |
| VM-CPT + CoT SFTCPT=true, SFT=true, RL=false2025.10 | 22.75 | |
| CoT SFTCPT=false, SFT=true, RL=false2025.10 | 17.8 | |
| Direct SFTCPT=false, SFT=true, RL=false2025.10 | 15.15 | |
| In-ContextMode=Zero-Shot with Policy In-Context2025.10 | 13.15 |