List your company
ResearchFormerly WizWand

Competitive Programming on USACO Benchmark

19.9Pass@1Retrieve w/ASM-PL
8.9811.81514.6517.485Jul 21, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Retrieve w/ASM-PLModel=GPT-4o, Shot-count=1-shot2025.0719.9
Retrieve w/ASM-NLModel=GPT-4o, Shot-count=1-shot2025.0719.2
Episodic Retrieval*Model=GPT-4o, Shot-count=1-shot2025.0718.6
Retrieve w/RandomModel=GPT-4o, Shot-count=1-shot2025.0717.9
w/o ExemplarModel=GPT-4o, Shot-count=1-shot2025.0717.3
Retrieve w/StatementModel=GPT-4o, Shot-count=1-shot2025.0716.9
Retrieve w/ASM-NLModel=GPT-4o-mini, Shot-count=1-shot2025.0713.7
Retrieve w/ASM-PLModel=GPT-4o-mini, Shot-count=1-shot2025.0713
Episodic Retrieval*Model=GPT-4o-mini, Shot-count=1-shot2025.0712.4
Retrieve w/StatementModel=GPT-4o-mini, Shot-count=1-shot2025.0711.4
Retrieve w/RandomModel=GPT-4o-mini, Shot-count=1-shot2025.0710.4
w/o ExemplarModel=GPT-4o-mini, Shot-count=1-shot2025.079.4