Skill Evolution on S-Bench
54.8AccuracyALIGNEVOSKILL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ALIGNEVOSKILLLLM=GPT-5.4, Evolution Setting=Human-Labeled2025.06 | 54.8 | — | |
| CoEvoSkillsLLM=GPT-5.4, Evolution Setting=Human-Labeled2025.06 | 52.4 | — | |
| SkillXLLM=GPT-5.4, Evolution Setting=Human-Labeled2025.06 | 51.2 | — | |
| Trace2SkillLLM=GPT-5.4, Evolution Setting=Human-Labeled2025.06 | 50 | — | |
| ALIGNEVOSKILLLLM=GPT-5.4, Evolution Setting=From-Scratch2025.06 | 48.8 | — | |
| CoEvoSkillsLLM=GPT-5.4, Evolution Setting=From-Scratch2025.06 | 46.4 | — | |
| SkillXLLM=GPT-5.4, Evolution Setting=From-Scratch2025.06 | 45.2 | — | |
| BaseLLM=GPT-5.4, Evolution Setting=Human-Labeled2025.06 | 45.2 | — | |
| Trace2SkillLLM=GPT-5.4, Evolution Setting=From-Scratch2025.06 | 42.9 | — | |
| BaseLLM=GPT-5.4, Evolution Setting=From-Scratch2025.06 | 39.3 | — | |
| ALIGNEVOSKILLLLM=DEEPSEEK-V4-FLASH, Evolution Setting=Human-Labeled2025.06 | 34.5 | — | |
| CoEvoSkillsLLM=DEEPSEEK-V4-FLASH, Evolution Setting=Human-Labeled2025.06 | 32.1 | — | |
| SkillXLLM=DEEPSEEK-V4-FLASH, Evolution Setting=Human-Labeled2025.06 | 31 | — | |
| ALIGNEVOSKILLLLM=CLAUDE-HAIKU-4.5, Evolution Setting=Human-Labeled2025.06 | 31 | — | |
| Trace2SkillLLM=DEEPSEEK-V4-FLASH, Evolution Setting=Human-Labeled2025.06 | 29.8 | — | |
| ALIGNEVOSKILLLLM=CLAUDE-HAIKU-4.5, Evolution Setting=From-Scratch2025.06 | 28.6 | — | |
| CoEvoSkillsLLM=CLAUDE-HAIKU-4.5, Evolution Setting=Human-Labeled2025.06 | 28.6 | — | |
| SkillXLLM=CLAUDE-HAIKU-4.5, Evolution Setting=Human-Labeled2025.06 | 27.4 | — | |
| ALIGNEVOSKILLLLM=DEEPSEEK-V4-FLASH, Evolution Setting=From-Scratch2025.06 | 26.2 | — | |
| CoEvoSkillsLLM=CLAUDE-HAIKU-4.5, Evolution Setting=From-Scratch2025.06 | 26.2 | — | |
| ALIGNEVOSKILLLLM=GPT-5.4-NANO, Evolution Setting=Human-Labeled2025.06 | 26.2 | — | |
| SkillXLLM=CLAUDE-HAIKU-4.5, Evolution Setting=From-Scratch2025.06 | 25 | — | |
| CoEvoSkillsLLM=GPT-5.4-NANO, Evolution Setting=Human-Labeled2025.06 | 25 | — | |
| CoEvoSkillsLLM=DEEPSEEK-V4-FLASH, Evolution Setting=From-Scratch2025.06 | 23.8 | — | |
| Trace2SkillLLM=CLAUDE-HAIKU-4.5, Evolution Setting=Human-Labeled2025.06 | 23.8 | — | |
| SkillXLLM=GPT-5.4-NANO, Evolution Setting=Human-Labeled2025.06 | 23.8 | — | |
| SkillXLLM=DEEPSEEK-V4-FLASH, Evolution Setting=From-Scratch2025.06 | 22.6 | — | |
| BaseLLM=DEEPSEEK-V4-FLASH, Evolution Setting=Human-Labeled2025.06 | 22.6 | — | |
| Trace2SkillLLM=CLAUDE-HAIKU-4.5, Evolution Setting=From-Scratch2025.06 | 22.6 | — | |
| Trace2SkillLLM=GPT-5.4-NANO, Evolution Setting=Human-Labeled2025.06 | 22.6 | — | |
| Trace2SkillLLM=DEEPSEEK-V4-FLASH, Evolution Setting=From-Scratch2025.06 | 21.4 | — | |
| BaseLLM=CLAUDE-HAIKU-4.5, Evolution Setting=From-Scratch2025.06 | 19 | — | |
| ALIGNEVOSKILLLLM=GPT-5.4-NANO, Evolution Setting=From-Scratch2025.06 | 19 | — | |
| CoEvoSkillsLLM=GPT-5.4-NANO, Evolution Setting=From-Scratch2025.06 | 16.7 | — | |
| SkillXLLM=GPT-5.4-NANO, Evolution Setting=From-Scratch2025.06 | 15.5 | — | |
| Trace2SkillLLM=GPT-5.4-NANO, Evolution Setting=From-Scratch2025.06 | 14.3 | — | |
| BaseLLM=DEEPSEEK-V4-FLASH, Evolution Setting=From-Scratch2025.06 | 13.1 | — | |
| BaseLLM=CLAUDE-HAIKU-4.5, Evolution Setting=Human-Labeled2025.06 | 9.5 | — | |
| BaseLLM=GPT-5.4-NANO, Evolution Setting=Human-Labeled2025.06 | 9.5 | — | |
| BaseLLM=GPT-5.4-NANO, Evolution Setting=From-Scratch2025.06 | 3.6 | — |