this post was submitted on 11 Oct 2023
362 points (97.6% liked)

Programming

17534 readers
105 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities [email protected]



founded 2 years ago
MODERATORS
 

"UPDATE table_name SET w = $1, x = $2, z = $4 WHERE y = $3 RETURNING *",

does not do the same as

"UPDATE table_name SET w = $1, x = $2, y = $3, z = $4 RETURNING *",

It's 2 am and my mind blanked out the WHERE, and just wanted the numbers neatly in order of 1234.

idiot.

FML.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 109 points 1 year ago* (last edited 1 year ago) (4 children)

This is a hard lesson to learn. From now on, my guess is you will have dozens of backups.

[–] [email protected] 64 points 1 year ago (1 children)

And a development environment. And not touch production without running the exact code at least once and being well slept.

[–] [email protected] 8 points 1 year ago (2 children)

Fuck that, get shit housed and still do it right. That's a pro.

[–] [email protected] 19 points 1 year ago (1 children)

That's not pro, that's just reckless gambling.

[–] [email protected] 3 points 1 year ago

Totally right! You must set yourself up so a fool can run in prod and produce the expected result. Which is the purpose of a test env.

[–] [email protected] 0 points 1 year ago* (last edited 1 year ago)

Replied hastily, but the way to run db statements in prod while dealing with sleep deprivation and drinking too much is to run it a bunch in several test env scenarios so you're just copy pasting to prod and it CAN confidently be done. Also enable transactions and determine several, valid smoke tests.

Edit: a -> several

[–] [email protected] 28 points 1 year ago (1 children)

And always use a transaction so you're required to commit to make it permanent. See an unexpected result? Rollback.

[–] [email protected] 11 points 1 year ago (2 children)

Transactions aren't backups. You can just as easily commit before fully realizing it. Backups, backups, backups.

[–] [email protected] 20 points 1 year ago (1 children)

Yes, but

  1. Begin transaction
  2. Update table set x='oopsie'
  3. Sees 42096 rows affected
  4. Rollback

Can prevent a restore, whereas doing the update with auto commit guarantees a restore on (mostly) every error you make

[–] [email protected] 3 points 1 year ago

Can prevent a restore, whereas doing the update with auto commit guarantees a restore on (mostly) every error you make

Exactly. Restores often result in system downtime and may take hours and involve lots of people. The backup might not have the latest data either, and restoring to a single table you screwed up may not be feasible or come with risk of inconsistent data being loaded. Even if you just created the backup before your statement, what about the transaction coming in while you're working and after you realize your error? Can you restore without impacting those?

You want to avoid all of that if possible. If you're mucking with data that you'll have to restore if you mess up, production or not, you should be working with an open transaction. As you said... if you see an unexpected number of rows updated, easy to rollback. And you can run queries after you've modified the data to confirm your table contains data as you expect now. Something surprising... rollback and re-think what you're doing. Better to never touch a backup and not shoot yourself in the foot and your data in the face all due to a stupid, easily preventable mistake.

[–] [email protected] 3 points 1 year ago

Backups are for emergencies.

Transactions are for oopsies.

[–] [email protected] 15 points 1 year ago

I've read something like "there are two kinds of people: those who backup and those who are about to"

[–] [email protected] 2 points 1 year ago

This is the way