Lemmy.ca's Main Community

3023 readers

31 users here now

Welcome to the lemmy.ca/c/main community!

All new users on lemmy.ca are automatically subscribed to this community, so this is the place to read announcements, make suggestions, and chat about the goings-on of lemmy.ca.

For support requests specific to lemmy.ca, you can use [email protected].

founded 4 years ago

MODERATORS

[email protected]

123

Server Maintenance - Jan 29th and Jan 30th at 9AM PT (lemmy.ca)

submitted 1 month ago* (last edited 1 month ago) by [email protected] to c/[email protected]

35 comments fedilink hide all child comments

Hello everyone!

I'll be taking the site down for two maintenance windows this week to complete our server migration.

Weds Jan 29th - 09:00 - 11:00 PT (12:00 - 14:00 ET)
Thurs Jan 30th - 09:00 - 11:00 PT (12:00 - 14:00 ET)

During the first window I'll be migrating us from OVH to our new dedicated hardware. After this migration there will likely be some temporarily broken images, as it takes approximately 8 hours to resync our object storage from OVH.

This is a major change and despite my testing, may have some unintended side effects. If you run into any problems that aren't just a broken image, please let us know.

The second maintenance window is to migrate our pict-rs database from it's local sled-db into our primary postgres DB. This is a much smaller change but since pict-rs checks every image as it goes through them, it takes about 1.5 hours.

As usual, you can check https://status.lemmy.ca/ for updates.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 3 weeks ago (1 children)

I've hacked in a dirty dirty fix for now. It looks like the pictrs database migration failed horribly and cloudflare was caching the images, so nobody noticed. Now I've got two copies of pictrs running (old + new) and some code in place to try both of them.

Sigh.

[–] [email protected] 1 points 3 weeks ago

Oh shit.... Well at least you found it before everything just stopped working? :(

Thanks for your efforts m8; I appreciate the hard work. Best of luck fixing that.