Programmer Humor

22262 readers

653 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

Keep content in english
No advertisements
Posts must be related to programming or programmer topics

founded 2 years ago

MODERATORS

[email protected]

955

muskrat's data eng expert's hard drive overheats while processing 60k rows (lemmy.dbzer0.com)

submitted 3 weeks ago by [email protected] to c/[email protected]

295 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 136 points 3 weeks ago (3 children)

60k is laughably, embarrassingly small. It's still sqlite-sized.

[–] naught 58 points 3 weeks ago (1 children)

i mean its even excel sized depending on how many columns. This is seriously sad and alarming

[–] [email protected] 11 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

Hey now that's real close to the 65,535 16-bit limit (from 20 years ago)

[–] [email protected] 3 points 3 weeks ago

Holy shit if this ids lm issue that’s too funny

[–] [email protected] 46 points 3 weeks ago (3 children)

Sqlite can easily handle millions of rows. Don't sell it short

[–] [email protected] 7 points 3 weeks ago (1 children)

How about a 6.4TB sqlite database?

https://boyter.org/posts/searchcode-bigger-sqlite-than-you/

[–] [email protected] 5 points 3 weeks ago

Should be enough to hold 60k rows

[–] [email protected] 3 points 3 weeks ago

I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable

[–] [email protected] 1 points 3 weeks ago

I'm not

[–] [email protected] 2 points 3 weeks ago

60k is single json file