List your company
ResearchFormerly WizWand

Task Planning on TaskBench Multimedia

88.54Node F1SGC
45.32856.546567.76578.9835May 29, 2024
Updated 8mo ago

Evaluation results

MethodLinks
SGCLLM=GPT-4-turbo2024.0588.5469.832.1
DirectLLM=GPT-4-turbo2024.0588.2969.382.28
BeamSearchLLM=GPT-4-turbo2024.0588.1670.396.9
AdaptiveSearchLLM=GPT-4-turbo2024.0588.0269.997.14
Greedy SearchLLM=GPT-4-turbo2024.0586.8169.85.52
SGCLLM=GPT-3.5-turbo2024.0583.6563.652.09
BeamSearchLLM=GPT-3.5-turbo2024.0583.5764.512.91
DirectLLM=GPT-3.5-turbo2024.0582.8562.072.26
AdaptiveSearchLLM=GPT-3.5-turbo2024.0581.8662.715.71
Greedy SearchLLM=GPT-3.5-turbo2024.0581.1163.024.92
SGCLLM=Mistral 7B2024.0574.0749.92.43
BeamSearchLLM=Mistral 7B2024.0573.5547.1231.1
SGCLLM=CodeLlama 13B2024.0573.3253.282.43
AdaptiveSearchLLM=Mistral 7B2024.0571.5944.8410.66
DirectLLM=Mistral 7B2024.0569.8339.852.64
BeamSearchLLM=CodeLlama 13B2024.0569.5343.3519.51
DirectLLM=CodeLlama 13B2024.0568.5741.792.59
AdaptiveSearchLLM=CodeLlama 13B2024.0568.1441.716.77
Greedy SearchLLM=CodeLlama 13B2024.0567.9842.044.95
SGCLLM=Vicuna 13B2024.0561.7837.62.43
GreedySearchLLM=Mistral 7B2024.0558.9234.726.26
BeamSearchLLM=Vicuna 13B2024.0554.0926.1925.42
DirectLLM=Vicuna 13B2024.0553.5723.192.64
AdaptiveSearchLLM=Vicuna 13B2024.0551.2424.3211.25
Greedy SearchLLM=Vicuna 13B2024.0546.9923.115.55