List your company
ResearchFormerly WizWand

Tool-use performance on Tau-bench Retail (test)

66Pass Rategpt-4o-FC-JOSH-SFT
14.904828.169941.43554.7001Sep 6, 2024
Updated 8mo ago

Evaluation results

MethodLinks
gpt-4o-FC-JOSH-SFTBackbone=gpt-4o, Prompting=Function Calling (FC), Training=JOSH-SFT2024.0966
gpt-4o-FCBackbone=gpt-4o, Prompting=Function Calling (FC)2024.0965.21
gpt-4o-ACT-JOSH-SFTBackbone=gpt-4o, Prompting=ACT, Training=JOSH-SFT2024.0964.26
gpt-4o-ACTBackbone=gpt-4o, Prompting=ACT2024.0963.13
gpt-4o-ReACT-JOSH-SFTBackbone=gpt-4o, Prompting=ReACT, Training=JOSH-SFT2024.0958.43
gpt-4o-mini-FC-JOSH-SFTBackbone=gpt-4o-mini, Prompting=Function Calling (FC), Training=JOSH-SFT2024.0958.26
gpt-4o-ReACTBackbone=gpt-4o, Prompting=ReACT2024.0954.43
gpt-4o-mini-FCBackbone=gpt-4o-mini, Prompting=Function Calling (FC)2024.0950.78
gpt-4o-mini-ACT-JOSH-SFTBackbone=gpt-4o-mini, Prompting=ACT, Training=JOSH-SFT2024.0947.65
gpt-4o-mini-ACTBackbone=gpt-4o-mini, Prompting=ACT2024.0944.6
gpt-4o-mini-ReACT-JOSH-SFTBackbone=gpt-4o-mini, Prompting=ReACT, Training=JOSH-SFT2024.0936.34
gpt-4o-mini-ReACTBackbone=gpt-4o-mini, Prompting=ReACT2024.0916.87