List your company

Tool Learning on API-Bank LV2

62.41CorrectnessToolCoder
33.726841.173448.6256.0666Feb 17, 2025

Evaluation results

MethodLinks
ToolCoderBackbone=gpt-4o-mini, Paradigm=Code-based2025.0262.41
ToolCoder w/o Reusable RepositoryBackbone=gpt-4o-mini, Paradigm=Code-based, Reusable Repository=false, Note=Mechanism disabled in this dataset2025.0262.41
EasyToolBackbone=gpt-4o-mini, Paradigm=Text-based2025.0258.24
ToolCoder w/o Error ReflectionBackbone=gpt-4o-mini, Paradigm=Code-based, Error Reflection=false2025.0258.02
ReActBackbone=gpt-4o-mini, Paradigm=Text-based2025.0256.3
CodeActBackbone=gpt-4o-mini, Paradigm=Code-based2025.0254.07
ATCBackbone=gpt-4o-mini, Paradigm=Code-based2025.0252.18
ChameleonBackbone=gpt-4o-mini, Paradigm=Text-based2025.0237.04
ConAgentsBackbone=gpt-4o-mini, Paradigm=Text-based2025.0236.24
RestGPTBackbone=gpt-4o-mini, Paradigm=Text-based2025.0234.83