this post was submitted on 07 Apr 2024
514 points (95.7% liked)

Security

4939 readers
3 users here now

Confidentiality Integrity Availability

founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 4 points 5 months ago

There's also the question of what happens if they just ignore the robots.txt file