Single-turn Reasoning on AIME24, AIME25, and GPQA
92.2AIME 2024 AccuracySKillOS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SKillOSExecutor=Gemini-2.5-pro, Curator=Qwen3-8B2026.05 | 92.2 | 86.7 | 86.8 | 88.6 | |
| SKillOS-geminiExecutor=Gemini-2.5-pro, Curator=Gemini-2.5-pro2026.05 | 90 | 85.6 | 80.7 | 85.4 | |
| SKillOS-baseExecutor=Gemini-2.5-pro, Curator=Qwen3-8B2026.05 | 87.8 | 83.3 | 82.8 | 84.6 | |
| SKillOSExecutor=Qwen3-32B, Curator=Qwen3-8B2026.05 | 85.6 | 81.1 | 72.4 | 79.7 | |
| No MemoryExecutor=Gemini-2.5-pro, Curator=None2026.05 | 85.6 | 80 | 79.9 | 81.8 | |
| ReasoningBankExecutor=Gemini-2.5-pro, Curator=Gemini-2.5-pro2026.05 | 85.6 | 84.4 | 80.4 | 83.5 | |
| MemPExecutor=Gemini-2.5-pro, Curator=Gemini-2.5-pro2026.05 | 83.3 | 76.7 | 81.8 | 80.6 | |
| MemPExecutor=Qwen3-32B, Curator=Qwen3-32B2026.05 | 82.2 | 76.7 | 66.5 | 75.1 | |
| No MemoryExecutor=Qwen3-32B, Curator=None2026.05 | 81.4 | 72.2 | 68.4 | 74 | |
| ReasoningBankExecutor=Qwen3-32B, Curator=Qwen3-32B2026.05 | 81.1 | 75.6 | 66.9 | 74.9 | |
| SKillOSExecutor=Qwen3-8B, Curator=Qwen3-8B2026.05 | 80 | 76.7 | 64.6 | 73.8 | |
| SKillOS-baseExecutor=Qwen3-32B, Curator=Qwen3-8B2026.05 | 80 | 75.6 | 67.7 | 74.7 | |
| SKillOS-geminiExecutor=Qwen3-32B, Curator=Gemini-2.5-pro2026.05 | 77.8 | 74.4 | 66.2 | 73.2 | |
| No MemoryExecutor=Qwen3-8B, Curator=None2026.05 | 76 | 71.1 | 61.8 | 69.6 | |
| MemPExecutor=Qwen3-8B, Curator=Qwen3-8B2026.05 | 75.6 | 71.1 | 60.6 | 69.1 | |
| SKillOS-baseExecutor=Qwen3-8B, Curator=Qwen3-8B2026.05 | 75.6 | 71.9 | 59.3 | 68.9 | |
| ReasoningBankExecutor=Qwen3-8B, Curator=Qwen3-8B2026.05 | 75.4 | 73.2 | 60.3 | 69.6 | |
| SKillOS-geminiExecutor=Qwen3-8B, Curator=Gemini-2.5-pro2026.05 | 73.3 | 71.3 | 57.6 | 67.4 |