List your company
ResearchFormerly WizWand

Interactive Agent Task on ScienceWorld Seen (Average Reward)

77.1Average RewardBPO
24.621638.245851.8765.4942Aug 5, 2025
Updated 5mo ago

Evaluation results

MethodLinks
BPOApproach=System-2, Evaluation Protocol=Fine-Tuned, Base Model=Llama-3.1-8B-Instruct2025.0877.1
MPOApproach=System-2, Evaluation Protocol=Fine-Tuned, Base Model=Llama-3.1-8B-Instruct2025.0871.61
ETOApproach=System-2, Evaluation Protocol=Fine-Tuned, Base Model=Llama-3.1-8B-Instruct2025.0865.69
Deepseek-R1Approach=System-2, Evaluation Protocol=Zero-shot2025.0863.96
SFTApproach=System-2, Evaluation Protocol=Fine-Tuned, Base Model=Llama-3.1-8B-Instruct2025.0858.82
o3-miniApproach=System-2, Evaluation Protocol=Zero-shot2025.0856.95
Qwen-3-ThinkingApproach=System-2, Evaluation Protocol=Zero-shot2025.0852.05
Qwen-2.5-7B-InstructApproach=System-1, Evaluation Protocol=Zero-shot2025.0826.68
Llama-3.1-8B-InstructApproach=System-1, Evaluation Protocol=Zero-shot2025.0826.64