List your company
ResearchFormerly WizWand

Function Calling on BFCL (Held-In)

89.4AccuracySHAD+RFT
79.946482.400784.85587.3093Dec 19, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SHAD+RFTModel=LLaMA3.1-8B2024.1289.4
RewardFTModel=LLaMA3-8B2024.1289.3
SFTModel=LLaMA3.1-8B2024.1289.3
RewardFTModel=LLaMA3.1-8B2024.1288.2
SHAD+α-FTModel=LLaMA3.1-8B2024.1288.2
SHAD+RFTModel=LLaMA3-8B2024.1287.6
SHAD+α-FTModel=LLaMA3-8B2024.1287.2
SFTModel=LLaMA3-8B2024.1285.9
Rho-1Model=LLaMA3.1-8B2024.1284.6
Regex+RFTModel=LLaMA3-8B2024.1283.81
Rho-1Model=LLaMA3-8B2024.1282.9
RegexModel=LLaMA3.1-8B2024.1282.1
RegexModel=LLaMA3-8B2024.1281
Regex+RFTModel=LLaMA3.1-8B2024.1280.31