Honestly, I don't like GTK apps either. I dislike them less than Qt apps for the same reasons you give. But GTK stuff is still really heavy and bulky and pulls in a lot of dependencies even if it's not quite so bad as Qt stuff.
When I can, I use apps that just depend on xlib or (even better) xcb. I'm a huge fan of suckless software, for instance. (Well, like you, when I can, I use a CLI program. But if there just isn't a reasonable way to do something without a GUI, xlib/xcb is the way I prefer to go. But that isn't often an option. Like, if you want a full-featured browser, it's GTK whether it's Firefox or Chromium.)
I did make the jump to a Wayland compositor. (Sway. It's as close to a drop-in replacement for i3+X11 as you can get.) So I guess even better than xlib/xcb would be the Wayland library. But in most cases I'd rather use X programs that are in my distro's repositories than go outside of my distro's repositories to use Wayland equivalents. (Like, I use "dmenu" because there isn't a Wayland equivalent in the Arch repository. I am specifically in the process of switching from Arch to Gentoo, though, so it's very possible that could change things moving forward.)
Also, just because it's apropos, I have literally written my own domain-specific language just so I could avoid using a GUI for one specific use case. Lol.