Tool Learning on API-Bank LV2
62.41CorrectnessToolCoder
Evaluation Results
| Method | Links | |
|---|---|---|
| ToolCoderBackbone=gpt-4o-mini, Paradigm=Code-based2025.02 | 62.41 | |
| ToolCoder w/o Reusable RepositoryBackbone=gpt-4o-mini, Paradigm=Code-based, Reusable Repository=false, Note=Mechanism disabled in this dataset2025.02 | 62.41 | |
| EasyToolBackbone=gpt-4o-mini, Paradigm=Text-based2025.02 | 58.24 | |
| ToolCoder w/o Error ReflectionBackbone=gpt-4o-mini, Paradigm=Code-based, Error Reflection=false2025.02 | 58.02 | |
| ReActBackbone=gpt-4o-mini, Paradigm=Text-based2025.02 | 56.3 | |
| CodeActBackbone=gpt-4o-mini, Paradigm=Code-based2025.02 | 54.07 | |
| ATCBackbone=gpt-4o-mini, Paradigm=Code-based2025.02 | 52.18 | |
| ChameleonBackbone=gpt-4o-mini, Paradigm=Text-based2025.02 | 37.04 | |
| ConAgentsBackbone=gpt-4o-mini, Paradigm=Text-based2025.02 | 36.24 | |
| RestGPTBackbone=gpt-4o-mini, Paradigm=Text-based2025.02 | 34.83 |