List your company
ResearchFormerly WizWand

Task Planning on Hugging Face v1 (test)

77.79n-F1SGC
28.691641.438354.18566.9317May 29, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SGCLLM=GPT 4-turbo2024.0577.7952.22,030
DirectLLM=GPT 4-turbo2024.0577.652.182,190
SGCLLM=GPT 3.5-turbo2024.0576.3750.042,020
DirectLLM=GPT 3.5-turbo2024.0573.8545.732,140
SGCLLM=Mistral 7B2024.0567.4342.082,320
SGCLLM=CodeLlama 13B2024.0565.5139.442,310
SGCLLM=CodeLlama 7B2024.0563.9839.272,300
DirectLLM=Mistral 7B2024.0560.630.232,490
SGCLLM=Vicuna 13B2024.0559.6231.982,310
DirectLLM=CodeLlama 7B2024.0558.0629.392,440
DirectLLM=CodeLlama 13B2024.0557.5528.882,450
SGCLLM=Baichuan2 13B2024.0556.5329.942,280
DirectLLM=Vicuna 13B2024.0550.4621.272,500
DirectLLM=Baichuan2 13B2024.0545.85192,430
BeamSearchLLM=Baichuan2 13B2024.0541.069.5924,690
AdaptiveSearchLLM=Baichuan2 13B2024.0539.310.4110,810
GreedySearchLLM=Baichuan2 13B2024.0530.584.896,420