Rock-Paper-Scissors on Rock-Paper-Scissors (RPS)
3.28RPS@5 ScoreMemory w/ MEMOPILOT
Evaluation Results
| Method | Links | |
|---|---|---|
| Memory w/ MEMOPILOTPlayer Model=Qwen2.5-14B-Instruct2026.06 | 3.28 | |
| Memory w/ MEMOPILOTPlayer Model=Qwen3-235B-A22B2026.06 | 3.27 | |
| Memory w/ DeepSeek-V3.2Player Model=Qwen2.5-14B-Instruct2026.06 | 1.64 | |
| Memory w/ DeepSeek-V3.2Player Model=Qwen3-235B-A22B2026.06 | 1.46 | |
| Human-Written Counter-StrategyPlayer Model=Qwen2.5-14B-Instruct2026.06 | 1 | |
| ReasoningBankPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.81 | |
| ReasoningBankPlayer Model=Qwen3-235B-A22B2026.06 | 0.81 | |
| AWMPlayer Model=Qwen3-235B-A22B2026.06 | 0.67 | |
| AWMPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.64 | |
| ReflexionPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.61 | |
| Human-Written Counter-StrategyPlayer Model=Qwen3-235B-A22B2026.06 | 0.57 | |
| Memory w/ Gemini-3.0-FlashPlayer Model=Qwen3-235B-A22B2026.06 | 0.54 | |
| ReflexionPlayer Model=Qwen3-235B-A22B2026.06 | 0.53 | |
| MemoryBankPlayer Model=Qwen3-235B-A22B2026.06 | 0.48 | |
| Memory w/ Gemini-3.0-FlashPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.45 | |
| No MemoryPlayer Model=Qwen3-235B-A22B2026.06 | 0.44 | |
| No MemoryPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.43 | |
| MemoryBankPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.43 | |
| Memory w/ Qwen2.5-7B-InstructPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.36 | |
| Memory w/ Qwen2.5-14B-InstructPlayer Model=Qwen3-235B-A22B2026.06 | 0.34 | |
| Memory w/ Qwen2.5-14B-InstructPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.21 | |
| Memory w/ Qwen2.5-7B-InstructPlayer Model=Qwen3-235B-A22B2026.06 | 0.19 | |
| Full HistoryPlayer Model=Qwen3-235B-A22B2026.06 | 0.03 | |
| ExpeLPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.03 | |
| Full HistoryPlayer Model=Qwen2.5-14B-Instruct2026.06 | 0.02 | |
| ExpeLPlayer Model=Qwen3-235B-A22B2026.06 | -0.02 |