List your company
ResearchFormerly WizWand

Autonomous Agent Planning and Execution on Task Performance Environment (test)

0.387RewardSFT+RL
0.202920.250710.29850.34629Sep 3, 2025
Updated 8mo ago

Evaluation results

MethodLinks
SFT+RLSize=8B, Strategy=Dynamic2025.090.3871,714.3
Zero-shotSize=70B, Strategy=4 steps2025.090.37911,510.9
Zero-shotSize=70B, Strategy=Always2025.090.34938,836.2
Zero-shotSize=70B, Strategy=Never2025.090.343559.6
SFTSize=8B, Strategy=Dynamic2025.090.3431,869.9
SFT+RLSize=8B, Strategy=Never2025.090.298878
SFTSize=8B, Strategy=Never2025.090.286991.5
Base+RLSize=8B, Strategy=Never2025.090.274505.1
Base+RLSize=8B, Strategy=Dynamic2025.090.2110,818.7