Tool-calling on When2Call
76.8F1 ScoreGPT-1.5 Realtime
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-1.5 RealtimeTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 76.8 | |
| GPT-1.5 RealtimeTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 74.6 | |
| GPT-Mini RealtimeTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 74.5 | |
| GPT-1.5 RealtimeTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 72.6 | |
| GPT-4o RealtimeTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 71.4 | |
| GPT-1.5 RealtimeTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 71 | |
| GPT-4o RealtimeTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 70.7 | |
| GPT-4o RealtimeTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 70.3 | |
| GPT-1.5 RealtimeTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 70.2 | |
| GPT-Mini RealtimeTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 70.2 | |
| GPT-4o RealtimeTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 70.1 | |
| GPT-Mini RealtimeTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 69.7 | |
| GPT-4o RealtimeTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 69.3 | |
| GPT-4o RealtimeTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 68.9 | |
| GPT-Mini RealtimeTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 68.7 | |
| Gemini-3.1 Flash-LiveTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 66.7 | |
| GPT-1.5 RealtimeTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 66.1 | |
| Gemini-3.1 Flash-LiveTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 65.7 | |
| GPT-Mini RealtimeTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 65.4 | |
| GPT-Mini RealtimeTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 63.3 | |
| Gemini-3.1 Flash-LiveTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 62.8 | |
| Gemini-3.1 Flash-LiveTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 62.8 | |
| Gemini-3.1 Flash-LiveTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 62.7 | |
| Qwen3 OmniTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 61.3 | |
| Qwen3 OmniTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 61.2 | |
| Qwen3 OmniTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 61 | |
| Gemini-2.5 Flash-LiveTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 60.8 | |
| Qwen3 OmniTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 60.6 | |
| Qwen3 OmniTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 60.3 | |
| Gemini-3.1 Flash-LiveTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 60 | |
| Gemini-2.5 Flash-LiveTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 58.9 | |
| Qwen3 OmniTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 58.3 | |
| Gemini-2.5 Flash-LiveTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 57 | |
| Gemini-2.5 Flash-LiveTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 57 | |
| Gemini-2.5 Flash-LiveTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 56.6 | |
| Phi-4 MMTTS Model=GPT-4o-Mini, Voice=Ash (M)2026.05 | 56.1 | |
| Phi-4 MMTTS Model=GPT-4o-Mini, Voice=Coral (F)2026.05 | 54.7 | |
| Phi-4 MMTTS Model=Gemini-2.5-Flash, Voice=Kore (F)2026.05 | 54 | |
| Phi-4 MMTTS Model=Gemini-2.5-Flash, Voice=Orus (M)2026.05 | 53.4 | |
| Phi-4 MMTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 52.6 | |
| Gemini-2.5 Flash-LiveTTS Model=Gemini-2.5-Pro, Voice=Kore (F)2026.05 | 51 | |
| Phi-4 MMTTS Model=Gemini-2.5-Pro, Voice=Orus (M)2026.05 | 50.6 |