Thanks for explaining. I use group chats for IRL friends. It's strange that some prefer mastodon because of the twitter format. I suppose it's like private Facebook groups.
I like the sharp distinction between private stuff and searchable stuff. So it's good to have them as IM vs forum formats.
Seems like a fork of mumble with better UI would work for you.