Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Function Calling research benchmarks – Page 2 · SOTA2 Research

Function Calling

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0.807FSA

18

Feb 26, 2026

4.2Energy (Wh)

18

Feb 26, 2026

86.67Accuracy (%)

17

Jun 2, 2026

BFCL Multi-Turn v4 (test)

46.75Overall Acc

17

Feb 26, 2026

BFCL held-out V4 (test)

52.4Average Score

16

Jul 8, 2026

1Average Rank

16

May 11, 2026

OpenThinkerAgent-32B

85.9Accuracy

14

Jun 24, 2026

FinTool-Qwen3-8B

46.9BFCL Score

14

Jun 19, 2026

Llama 3.1 Instruct

77.9Accuracy

14

Mar 18, 2026

ToolBench I3-Inst

Claude-3.5-Sonnet + TAFC

52.4Pass Rate

14

Feb 26, 2026

ToolBench I2-Inst

Claude-3.5-Sonnet + TAFC

71.4Pass Rate

14

Feb 26, 2026

ToolBench I1-Inst

Claude-3.5-Sonnet + TAFC

57.1Pass Rate

14

Feb 26, 2026

89.4Accuracy

14

Feb 26, 2026

86.85Simple Accuracy

13

May 29, 2026

ACEBench Normal

75.6Accuracy

13

Feb 26, 2026

BFCL Average v4

63Accuracy

12

May 26, 2026

BFCL Non-Live v4

87.06Accuracy

12

May 26, 2026

79.68Accuracy

12

May 26, 2026

Others (SealTools, OpenFunc, ToolAlpaca)

87.4Overall Accuracy

12

Mar 4, 2026

94.6Overall Accuracy

12

Mar 4, 2026

77.9Overall Accuracy

12

Mar 4, 2026

BFCL Non-Live v3

94Overall Accuracy

12

Mar 4, 2026

84.5Overall Accuracy

12

Mar 4, 2026

BFCL Executable (test)

100Success Rate (Simple, Python)

12

Feb 26, 2026

API-Bank Level-2

83.2ROUGE-L

12

Apr 8, 2026

Page 2 of 5

Popular datasets

BFCL Berkeley Function Calling Leaderboard AISA-AR-FunctionCall ToolBench ACEBench

Follow for updates

Join SOTA2 Contact