Problem with voice grounded replies

Hello, I have modified the InteractiveAvatarNextJSDemo code so that it uses data from my Azure container and vector search. This is working great for text chatting with the avatar. But when I use the voice chat, the avatar first responds with an answer from the avatar's profile (Ann Therapist) before it actually recognizes the grounded reference. How can I avoid this? (I never want to use the default profile , I always it to answer from the grounded documents. )