this post was submitted on 20 Mar 2025
382 points (99.7% liked)

Open Source

35453 readers
431 users here now

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

Rules

Related Communities

Community icon from opensource.org, but we are not affiliated with them.

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 8 points 2 weeks ago (1 children)

They're absolutely not crawling it every time they nee to access the data. That's an incredible waste of processing power on their end as well.

In the case of code though that does change somewhat often. They'd still need to check if the code has been updated at the bare minimum.

[โ€“] [email protected] 1 points 2 weeks ago

Hashes for cached content. Anyone know what sort of DB makes sense here?