Can we update the knowledge base in between interaction with avatar during a live session?

I’m building a live interactive avatar that would require dynamically updating its knowledge base during ongoing interactions. Specifically, I want the avatar to retain the context of previous questions and answers so it can reference that history and ask more contextually relevant follow-up questions in real time.

Is it possible to achieve this using the Streaming API, and if so, what’s the best approach?