Disconnecting them from a power source is smarter. Just because the mic is muted doesn't mean it's not listening; it could simply be coded to not respond when the mic is muted yet listen in anyway.
Exactly why I said I'd unplug them if I were concerned. If I was a government official or someone who needed to keep important secrets, I wouldn't keep an AI in my house.