Restricted code system evaluation on ACI
74F1 ScoreSymphony
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SymphonyRuns=52026.03 | 74 | 81 | 68 | |
| ClaudeMethod Category=Fine-tune, Developer=AWS AI team2026.03 | 58 | — | — | |
| MedDCRMethod Category=Workflow, Developer=Oracle Health & AI2026.03 | 52 | 67 | 43 | |
| CoT-SCMethod Category=Agent2026.03 | 44 | 59 | 36 | |
| PLM-CAMethod Category=Fine-tune2026.03 | 43 | 42 | 44 | |
| ADASMethod Category=Agent2026.03 | 43 | 59 | 28 | |
| PLM-ICDMethod Category=Fine-tune2026.03 | 42 | 41 | 43 | |
| CoTMethod Category=Agent2026.03 | 41 | 50 | 35 | |
| RRSMethod Category=Workflow2026.03 | 35 | 52 | 26 | |
| JudgeMethod Category=Agent2026.03 | 33 | 64 | 22 | |
| MACMethod Category=Workflow2026.03 | 31 | 50 | 23 | |
| MulDeMethod Category=Agent2026.03 | 25 | 65 | 16 |