Tool-based Question Answering on ToolQA hard
63Accuracy (Yelp)React
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ReactModel=gpt-oss-120b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 63 | 14 | 22 | 32 | 11 | |
| ReactModel=Qwen3-32B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 51 | 14 | 14 | 24 | 10 | |
| ReactModel=Qwen3-14B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 47 | 14 | 13 | 23 | 3 | |
| ReflexionModel=gpt-oss-120b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 43 | 10 | 20 | 17 | 7 | |
| RP-ReActModel=gpt-oss-120b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 37 | 26 | 9 | 38 | 23 | |
| ReflexionModel=Qwen3-32B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 29 | 33 | 10 | 16 | 14 | |
| RP-ReActModel=Qwen3-32B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 27 | 20 | 13 | 27 | 18 | |
| ReflexionModel=Qwen3-14B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 24 | 7 | 8 | 6 | 7 | |
| RP-ReActModel=Qwen3-14B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 21 | 17 | 18 | 15 | 20 | |
| RP-ReActModel=gpt-oss-20b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 16 | 13 | 8 | 28 | 44 | |
| ReActModel=DeepSeek-8B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 10 | 0 | 0 | 11 | 3 | |
| ReActModel=DeepSeek-7B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 10 | 0 | 0 | 7 | 9 | |
| React-100Model=gpt-oss-20b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 6 | 13 | 7 | 14 | 29 | |
| ReflexionModel=gpt-oss-20b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 6 | 13 | 2 | 6 | 7 | |
| RP-ReActModel=DeepSeek-8B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 3 | 0 | 0 | 7 | 4 | |
| ReactModel=gpt-oss-20b, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 2 | 13 | 4 | 10 | 13 | |
| RP-ReActModel=DeepSeek-7B, Domain examples in prompt (P)=Yelp and Flight only2025.12 | 1 | 0 | 0 | 2 | 1 |