Documentation Generation on BFCL Opaque
78Semantic SimilarityTOOLOBSERVER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TOOLOBSERVERBackbone model=GPT-5, Documentation input setting=Anon. Fn. Names + Desc.2026.02 | 78 | 43 | |
| TOOLOBSERVERBackbone model=GPT-5-Mini, Documentation input setting=Anon. Fn. Names + Desc.2026.02 | 78 | 44 | |
| TOOLOBSERVERBackbone model=GPT-5, Documentation input setting=Anon. Fn. Names + Param. Names2026.02 | 71 | 40 | |
| TOOLOBSERVERBackbone model=GPT-5-Mini, Documentation input setting=Anon. Fn. Names + Param. Names2026.02 | 71 | 40 | |
| EasyToolDocumentation input setting=Anon. Fn. Names + Desc.2026.02 | 71 | 43 | |
| Play2PromptDocumentation input setting=Anon. Fn. Names + Desc.2026.02 | 70 | 31 | |
| Play2PromptDocumentation input setting=Anon. Fn. Names + Param. Names2026.02 | 69 | 28 | |
| EasyToolDocumentation input setting=Anon. Fn. Names + Param. Names2026.02 | 69 | 39 | |
| TOOLOBSERVERBackbone model=GPT-5-Mini, Documentation input setting=Anon. Fn. Names2026.02 | 58 | 28 | |
| Play2PromptDocumentation input setting=Anon. Fn. Names2026.02 | 51 | 18 | |
| TOOLOBSERVERBackbone model=GPT-5, Documentation input setting=Anon. Fn. Names2026.02 | 44 | 21 | |
| EasyToolDocumentation input setting=Anon. Fn. Names2026.02 | 0 | 0 |