May 23, 2024
EHR Voice Assistant. An LLM-powered 24/7 assistant for physicians, saving time and making it easier to manage a complex daily schedule.
- What patient am I seeing next?
- Give me a summary of the patient's last visit.
- Am I seeing any patients today that have never been to our practice?
- Will I have time to eat lunch today?
For people who are building gen AI applications: the architecture here is:
- The Electronic Health Record system is a RAG data source
- Speech-to-speech workflow built on @pipecat_ai and @trydaily
- @openai GPT-4o
- Lots and lots of prompt engineering to allow for open-ended conversations *and* give succinct answers to the things that physicians generally need to know
- Physicians talk to the assistant from an app or by dialing a phone number. (Some physicians just want to use the assistant during their commute and find it easier to make a phone call rather than open an app.)
Code written by @chadbailey59.