List your company
ResearchFormerly WizWand

Synthetic Grammar Synthesis a^n b^n c^n

100AccuracySEM-CTRL
-0.56825.54151.6577.759Mar 3, 2025May 9, 2025Jul 16, 2025Sep 21, 2025Nov 28, 2025Feb 3, 2026Apr 12, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SEM-CTRLAlgorithm=SEM-CTRL, Model=Llama 1B2025.03100
SEM-CTRLAlgorithm=SEM-CTRL, Model=Llama 70B2025.03100
o4-miniAlgorithm=API, Model=o4-mini2025.03100
SEM-CTRLAlgorithm=SEM-CTRL, Model=Llama 1B2025.03100
SEM-CTRLAlgorithm=SEM-CTRL, Model=Llama 70B2025.03100
Llama 1BG=GASG2026.04100
Llama 1BG=G^ ASG2026.04100
Llama 70BG=GASG2026.04100
Llama 70BG=G^ ASG2026.04100
o1-previewAlgorithm=API, Model=o1-preview2025.0396.7
DeepSeek-R1Algorithm=API, Model=DeepSeek-R12025.0396.7
o4-miniAlgorithm=API, Model=o4-mini2025.0393.3
o4 miniG=-2026.0490
BoNAlgorithm=BoN, Model=Llama 70B2025.0388.9
o1G=-2026.0486.7
o1-previewAlgorithm=API, Model=o1-preview2025.0383.3
DeepSeek-R1Algorithm=API, Model=DeepSeek-R12025.0383.3
DeepSeek-R1G=-2026.0480
Llama 70BG=-2026.0476.7
BoNAlgorithm=BoN, Model=Llama 70B2025.0371.1
GPT 4.1G=-2026.0463.3
o3 miniG=-2026.0463.3
BaseAlgorithm=Base, Model=Llama 70B2025.0360
BoNAlgorithm=BoN, Model=Llama 1B2025.0348.9
BaseAlgorithm=Base, Model=Llama 70B2025.0330
Llama 1BG=-2026.0420
BaseAlgorithm=Base, Model=Llama 1B2025.0310
BoNAlgorithm=BoN, Model=Llama 1B2025.037.8
BaseAlgorithm=Base, Model=Llama 1B2025.033.3