Task Completion on TW Express
60.38Mean Normalised ScoreReAct
Evaluation results
| Method | Links | |
|---|---|---|
| ReActModel=Llama-3.1 8B2026.04 | 60.38 | |
| DORAModel=Llama-3.1 8B2026.04 | 52.89 | |
| Prompt ExploreModel=Llama-3.1 8B2026.04 | 52.77 | |
| DORAModel=Qwen-2.5 7B2026.04 | 51.17 | |
| Zero-shotModel=Qwen-2.5 7B2026.04 | 48.93 | |
| Zero-shotModel=Llama-3.1 8B2026.04 | 48.29 | |
| Prompt ExploreModel=Qwen-2.5 7B2026.04 | 47.81 | |
| Tree of ThoughtModel=Qwen-2.5 7B2026.04 | 45.9 | |
| DORAModel=Mistral Small 22B2026.04 | 43.12 | |
| Prompt ExploreModel=Mistral Small 22B2026.04 | 42.46 | |
| ReActModel=Qwen-2.5 7B2026.04 | 39.5 | |
| Chain of ThoughtModel=Qwen-2.5 7B2026.04 | 37.44 | |
| Zero-shotModel=Mistral Small 22B2026.04 | 31.7 | |
| Tree of ThoughtModel=Mistral Small 22B2026.04 | 26.4 | |
| Chain of ThoughtModel=Mistral Small 22B2026.04 | 25.16 | |
| Chain of ThoughtModel=Llama-3.1 8B2026.04 | 24.72 | |
| ReActModel=Mistral Small 22B2026.04 | 23.54 | |
| Tree of ThoughtModel=Llama-3.1 8B2026.04 | 15.52 |