Text-based Scientific Reasoning on ScienceWorld (Seen)
0.8498Average RewardDELTAMEM
Evaluation results
| Method | Links | |
|---|---|---|
| DELTAMEMLLM=DeepSeek-V4-flash, Decoding Temperature=0, Prompt Framework=ReAct, Node Embeddings=E5-base-v2, Learning Protocol=Online learning, in-context demonstration=nicl = 12026.06 | 0.8498 | |
| SynapseLLM=DeepSeek-V4-flash, Decoding Temperature=0, Prompt Framework=ReAct, Node Embeddings=E5-base-v2, Learning Protocol=Online learning, in-context demonstration=nicl = 12026.06 | 0.8452 | |
| AWMLLM=DeepSeek-V4-flash, Decoding Temperature=0, Prompt Framework=ReAct, Node Embeddings=E5-base-v2, Learning Protocol=Online learning, in-context demonstration=nicl = 12026.06 | 0.8052 | |
| RBankLLM=DeepSeek-V4-flash, Decoding Temperature=0, Prompt Framework=ReAct, Node Embeddings=E5-base-v2, Learning Protocol=Online learning, in-context demonstration=nicl = 12026.06 | 0.7942 | |
| No MemoryLLM=DeepSeek-V4-flash, Decoding Temperature=0, Prompt Framework=ReAct, Node Embeddings=E5-base-v2, Learning Protocol=Zero-shot, in-context demonstration=nicl = 12026.06 | 0.7716 |