This morning my kid asked the voice assistant to "Turn off the computers in this house".
I heard it, thought well that's a strange request but seems harmless because how is home assistant gonna turn off computers.
Me a little while later, "why is shit broken? What's happening!"
Turns out dumb me had adguard exposed to the voice assistant, it switched off all the adguard settings including the DNS rewriting that is the cornerstone of many of my self-hosted services.
I've since revoked that access.
In home assistant every entity has "assist" config, you can remove any entity from assist which in turn will prevent it from being included in "all" assist/voice target.
So you can have a plug for server without worry but need to remove it from assist.