Procedure Customization on CustomPlans (test)
0.6068Customized RateSEQUENTIAL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SEQUENTIALorder=Sequential (Modify then Verify), agent_type=Edit-based agents2023.11 | 0.6068 | 0.7233 | 0.5194 | |
| E2E Customizemode=End-to-end LLM2023.11 | 0.5505 | 0.4845 | 0.4146 | |
| UNIFIEDorder=Unified (Bag of edits), agent_type=Edit-based agents2023.11 | 0.5485 | 0.7136 | 0.4709 | |
| PARALLELorder=Parallel, agent_type=Edit-based agents2023.11 | 0.5388 | 0.7087 | 0.4563 | |
| Reverse SEQUENTIALorder=Reverse Sequential (Verify then Modify), agent_type=Edit-based agents2023.11 | 0.4223 | 0.6359 | 0.3447 |