Agentic Task Performance on τ-Telehealth
45Pass^1 RateFAMA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FAMABackbone=Qwen3-32B2026.04 | 45 | 37 | 35 | 35 | 35 | |
| ReActBackbone=Qwen3-14B2026.04 | 44 | 43 | 42 | 41 | 40 | |
| ReActBackbone=Qwen3-32B2026.04 | 43 | 37 | 34 | 32 | 30 | |
| ReActBackbone=Qwen2.5-72B-Instruct2026.04 | 43 | 39 | 38 | 35 | 34 | |
| FAMABackbone=Qwen3-14B2026.04 | 42 | 41 | 40 | 40 | 40 | |
| FCBackbone=Qwen3-32B2026.04 | 42 | 39 | 37 | 35 | 35 | |
| FAMABackbone=Qwen2.5-72B-Instruct2026.04 | 42 | 40 | 40 | 40 | 40 | |
| FCBackbone=Qwen2.5-72B-Instruct2026.04 | 41 | 36 | 32 | 31 | 30 | |
| IRMABackbone=Qwen3-14B2026.04 | 39.99 | 27.99 | 24.5 | 22 | 20 | |
| FCBackbone=Qwen3-14B2026.04 | 39 | 38 | 37 | 36 | 35 | |
| FCBackbone=Qwen3-4B-Instruct2026.04 | 34 | 27 | 24 | 22 | 20 | |
| FAMABackbone=Qwen3-4B-Instruct2026.04 | 32 | 24 | 20 | 18 | 17 | |
| IRMABackbone=Qwen2.5-72B-Instruct2026.04 | 31 | 28.5 | 27 | 26 | 25 | |
| IRMABackbone=Qwen3-32B2026.04 | 30 | 24.5 | 20 | 18 | 15 | |
| ReActBackbone=Qwen3-4B-Instruct2026.04 | 22.99 | 16 | 12.5 | 11 | 10 | |
| IRMABackbone=Qwen3-4B-Instruct2026.04 | 22.99 | 14.5 | 11 | 10 | 10 |