this post was submitted on 02 Aug 2024
345 points (97.5% liked)

Science Memes

10885 readers
3673 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.

This is a science community. We use the Dawkins definition of meme.



Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] gigachad 5 points 3 months ago (2 children)

I guess it's more of a critique of how bad CSV is for storing large data than pandas being inefficient

[–] [email protected] 13 points 3 months ago (2 children)

CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.

[–] [email protected] 4 points 3 months ago

Why do you have to personally attack me like that?

[–] naught 3 points 3 months ago

Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️

[–] [email protected] 4 points 3 months ago

Fine! .csv.gz ftw!