Wafer

It feels like a collaboration. It’s great to see a dedicated group of people pushing hard to support our needs, all while delivering exceptional performance on all of the hard engineering metrics that we require.

The performance we’re getting on the models we benchmarked was way better on Wafer than on other inference providers. You have the lowest latency we’ve seen from any provider we’ve tried, and it doesn’t go off a cliff when you increase the requests per minute. We get very consistent performance across our expected utilization range.

Any more than that and you start breaking the flow of the conversation. You never have a delay like that when talking to a human, and we are fundamentally social creatures — so we pick up on things like that very quickly.