List your company
ResearchFormerly WizWand

Task Planning on TaskBench Daily Life

97.36Node-F1Direct
40.804855.487470.1784.8526May 29, 2024
Updated 8mo ago

Evaluation results

MethodLinks
DirectLLM=GPT-4-turbo2024.0597.3684.583.37
Greedy SearchLLM=GPT-4-turbo2024.0597.3685.787.37
BeamSearchLLM=GPT-4-turbo2024.0597.3585.788.99
SGCLLM=GPT-4-turbo2024.0597.3585.763.16
AdaptiveSearchLLM=GPT-4-turbo2024.0597.385.89.04
SGCLLM=GPT-3.5-turbo2024.0596.3886.193.16
DirectLLM=GPT-3.5-turbo2024.0596.0983.653.36
BeamSearchLLM=GPT-3.5-turbo2024.0595.6682.7222.05
AdaptiveSearchLLM=GPT-3.5-turbo2024.0593.7981.418.53
Greedy SearchLLM=GPT-3.5-turbo2024.0593.7781.267.36
SGCLLM=CodeLlama 13B2024.0592.9679.573.64
BeamSearchLLM=CodeLlama 13B2024.0591.7476.619.19
Greedy SearchLLM=CodeLlama 13B2024.0591.576.565.54
AdaptiveSearchLLM=CodeLlama 13B2024.0591.3476.097.18
DirectLLM=CodeLlama 13B2024.0591.276.073.88
SGCLLM=Mistral 7B2024.0587.1366.493.54
AdaptiveSearchLLM=Mistral 7B2024.0586.3963.6510.92
BeamSearchLLM=Mistral 7B2024.0585.8761.5339.16
DirectLLM=Mistral 7B2024.0584.2653.633.77
SGCLLM=Vicuna 13B2024.0583.3363.773.82
GreedySearchLLM=Mistral 7B2024.0575.1849.478.27
DirectLLM=Vicuna 13B2024.0573.745.83.82
AdaptiveSearchLLM=Vicuna 13B2024.0562.7131.1513.92
BeamSearchLLM=Vicuna 13B2024.0554.5523.624.86
Greedy SearchLLM=Vicuna 13B2024.0542.9813.337.18