Task Planning on Task Planning Evaluation Dataset sequential tasks GPT-4 annotated (test)
0.54Edit DistanceHuggingGPT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| HuggingGPTLLM=GPT-3.52023.03 | 0.54 | 61.09 | 45.15 | 51.92 | |
| HuggingGPTLLM=Vicuna-7b2023.03 | 0.8 | 19.15 | 28.45 | 22.89 | |
| HuggingGPTLLM=Alpaca-7b2023.03 | 0.83 | 22.27 | 23.35 | 22.8 |