this post was submitted on 30 Mar 2025
133 points (97.8% liked)

Selfhosted

45582 readers
1319 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 2 years ago
MODERATORS
 

Lemmy newb here, not sure if this is right for this /c.

An article I found from someone who hosts their own website and micro-social network, and their experience with web-scraping robots who refuse to respect robots.txt, and how they deal with them.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 20 hours ago (2 children)

But the way you described it sounded more nefarious

Oh. Yeah, I don't think they're being malicious; I just get frustrated with that sort of behavior. The primary DNS servers for usps.com, neakasa.com, and vitacost.com all block DNS queries from Mullvad's DNS servers, and one of them blocks all traffic from at least some of Mullvad's exit nodes. It means I have to waste time working around these blocks, because I'll be damned if I'm going to take down the house VPN just to visit their stupid sites. So, I hard-code DNS entries for them, and route traffic to the one through one of my VPSes. It's annoying, a waste of my time, and I'm just generally offended by the whiff of surveillance state about it, even when that's not the reason why they're doing it.

Really, it boils down to the fact that I'm offended by the presumption that their (not OP, but VPN-hostile companies in general) anti-spam or whatever they're trying to accomplish takes priority over my right to privacy. So, yeah; I generally have a bone to pick with any site that's hostile to VPNs.

Maybe that's just my perception.

I have no doubt at all that you're right. And, they have no obligation to accommodate me (which I think is not true for companies I'm trying to do business with).

I'm just uppity about the topic, is all.

I enjoy these discussions. I sometimes gain some new knowledge out of them.

I'll happily have a cordial disagreement with anyone arguing in good faith. It's echo-ey enough, and these are good conversations.

[–] [email protected] 1 points 1 hour ago

By the way, Mullvad rocks!

[–] [email protected] 1 points 1 hour ago

I completely understand your position and yes, organizations blocking VPN traffic is some major bullshit.

Like apps that ask for your location when they can perfectly function without it. Don't provide me with a "Never ask me again" checkbox? Fine, I'll play this game every time. Stop working because now you demand location? A stupid game app? Uninstalled.