Turn off closed captions

I turned on closed captions and now I cannot turn it off. Everytime I open an audio chat the CC system opens and turns on. I don’t want it on by default if I want closed captions I want to be able to turn it on and off on a per chat basis not auto start when I start an audio chat because I used it once out of curiosity.

Also are those chats stored somewhere or do they disappear after the audio chat is finished?