Programmer Humor

21658 readers

1039 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

Keep content in english
No advertisements
Posts must be related to programming or programmer topics

founded 2 years ago

MODERATORS

[email protected]

957

muskrat's data eng expert's hard drive overheats while processing 60k rows (lemmy.dbzer0.com)

submitted 2 days ago by [email protected] to c/[email protected]

304 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 142 points 2 days ago (3 children)

60k is laughably, embarrassingly small. It's still sqlite-sized.

[–] [email protected] 57 points 2 days ago (1 children)

i mean its even excel sized depending on how many columns. This is seriously sad and alarming

[–] [email protected] 11 points 2 days ago* (last edited 2 days ago) (1 children)

Hey now that's real close to the 65,535 16-bit limit (from 20 years ago)

[–] [email protected] 3 points 2 days ago

Holy shit if this ids lm issue that’s too funny

[–] [email protected] 49 points 2 days ago (3 children)

Sqlite can easily handle millions of rows. Don't sell it short

[–] [email protected] 8 points 2 days ago (1 children)

How about a 6.4TB sqlite database?

https://boyter.org/posts/searchcode-bigger-sqlite-than-you/

[–] [email protected] 6 points 2 days ago

Should be enough to hold 60k rows

[–] [email protected] 4 points 2 days ago

I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable

[–] [email protected] 1 points 2 days ago

I'm not

[–] [email protected] 4 points 2 days ago

60k is single json file