← kwindla hultman kramer

Realtime voice is growing really fast

March 10, 2025

Realtime voice is growing really fast.

LLMs are going to be answering the majority of phone calls to businesses within the next 12-18 months. That's a huge change, but the drivers are clear.

- Better performance than legacy call center tech stacks and ability to handle a much wider variety of tasks.
- Better performance than *human call center agents* on a growing subset of tasks.
- Freeing up small business employees to do things other than answer the phone. (Small businesses, such as restaurants, struggle to answer their inbound phone calls.)

I also think we're going to start seeing breakthrough consumer "talk to an LLM" applications. There are some early, interesting successes and experiments. Soon, everybody will have access to personalized coaches, tutors, advisors, friends, gaming companions, therapists, etc. But all those words will be imperfect analogies for what we do when we talk to LLMs because LLMs are different from people. This is a new thing.

Raveesh 折図@raveeshbhalla

Question: what’s an AI product that you use today that hasn’t quite broken through yet, like Cursor 12 months ago or Perplexity 18 months ago?

2025 is also going to be a breakout year for realtime conversational video. See, for example, what @heytavus is doing.

https://t.co/lOJLvHWpva

kwindla@kwindla

The new @heytavus video avatars are really good. Tavus has always excelled at conversational responsiveness. Their new release maintains that impressive low latency and adds a lot of new features and interesting model capabilities.

If you haven't tried their demo yet, you should. A fully integrated, realtime conversational video experience is one of those new AI things that we're going to take for granted in a relatively short period of time. But for the next few months, that future will not yet be evenly distributed!

The demo includes Internet search, video input from camera and screenshare, and a multimodal UX with conversation "artifacts" in a dynamic sidebar.

Image from @kwindla's post