June 1, 2024
I was talking to someone at the Voice+AI event last week about how to generate character video streams on the fly. There are a lot of possible approaches depending on what you're trying to do. (And depending on how gpu rich you are!)
A very simple idea that works pretty well for cartoon characters is to create basic animation loops for just two states, talking and not talking.
@chadbailey59 has some nice sample code for this.
Here's the code[1]