Function Calling in-domain
364.54Latency (s)vocabulary trimming
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| vocabulary trimmingVocabulary Size=4,3802026.03 | 364.54 | -9.1 | 212.21 | 10 | |
| 128K vocab (baseline)Vocabulary Size=128K2026.03 | 401.02 | — | 192.9 | — |
| Method | Links | ||||
|---|---|---|---|---|---|
| vocabulary trimmingVocabulary Size=4,3802026.03 | 364.54 | -9.1 | 212.21 | 10 | |
| 128K vocab (baseline)Vocabulary Size=128K2026.03 | 401.02 | — | 192.9 | — |