← kwindla hultman kramer

Big @pipecat_ai release today

October 2, 2024

Big @pipecat_ai release today. Lots of low-level improvements to performance and ergonomics.

TTS service additions and improvements (Google, AWS, Azure). The event framework that makes it easy to build complex client apps and workflows is rounding out nicely.

I spent a lot of time on this release working on function calling implementations and tests, across multiple models. I have thoughts! I'll try to write them down soon.

There will be another release tomorrow, to add support for the OpenAI realtime API!

Follow along in the repo/discord if you're interested in Python+WebRTC tooling for gpt-4o-realtime-preview.

WIP PR for OpenAI Realtime API[1]

  1. https://github.com/pipecat-ai/pipecat/pull/541