← kwindla hultman kramer

Want to talk to Qwen 3?

April 29, 2025

Want to talk to Qwen 3?

Here's the 32B dense model, running on @basetenco. Read the thread for source code and Baseten credits ...

This is a pretty standard @pipecat_ai pipeline. I hacked together a class to stream from a Baseten SGLang endpoint. (The Baseten deployment was one click - very cool!)

- speech-to-text: @gladia_io
- llm Qwen 3 32B / SGLang / @basetenco
- text-to-speech: @cartesia_ai

Source code is here: https://t.co/4bcx7ioN0L…

The Baseten team is going to participate in the Voice AI and Voice Agents course, and is giving every student credits. More info here:

https://t.co/yjxxM3Brtw