Natural Language Understanding on HuRIC (test)
75.76Success OutputHybrid Grammar-based LLM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Hybrid Grammar-based LLM2026.04 | 75.76 | 48.48 | 88.07 | 24.24 | |
| API-based LLMFine-tuning=true2026.04 | 74.24 | 36.3 | 72.3 | 25.76 | |
| Grammar-based NLU2026.04 | 71.21 | 21.21 | 42.55 | 28.79 | |
| API-based LLMFine-tuning=false2026.04 | 3.03 | 0 | 0 | 96.67 |