ResearchBenchmarksEnvironment Interaction on MiniGridFollow41,000,000Environment Steps (M)ADD35,240,00074,120,000113,000,000151,880,000Jun 24, 2025Evaluation ResultsMethodMethodLinksEnvironment Steps (M)ADDPPO Updates=10kPPO Updates=10k2025.0641,000,000PLR⊥PPO Updates=10kPPO Updates=10k2025.0682,000,000ADDPPO Updates=20kPPO Updates=20k2025.0682,000,000ACCELPPO Updates=10kPPO Updates=10k2025.0693,000,000TRACEDPPO Updates=10kPPO Updates=10k2025.0693,000,000PLR⊥PPO Updates=20kPPO Updates=20k2025.06165,000,000ACCELPPO Updates=20kPPO Updates=20k2025.06185,000,000