Intent Alignment on ToolACE
85.71Aintent (GPT-5.0)IntentMiner
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| IntentMinerReasoner LLM=Gemini-2.52025.12 | 85.71 | 85.33 | 85.52 | 85.52 | |
| IntentMinerReasoner LLM=Llama-3.12025.12 | 83.99 | 81.78 | 84.95 | 83.57 | |
| IntentMinerReasoner LLM=GPT-4.12025.12 | 83.13 | 85.81 | 83.99 | 84.31 | |
| IntentMinerReasoner LLM=DeepSeek-V32025.12 | 82.55 | 84.66 | 82.36 | 83.19 | |
| IntentMinerReasoner LLM=Claude-3.52025.12 | 76.22 | 78.33 | 77.28 | 77.28 | |
| IntentMinerReasoner LLM=Qwen32025.12 | 74.78 | 70.95 | 73.83 | 73.19 |