People Twitter

5213 readers

2052 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

Mark NSFW content.
No doxxing people.
Must be a tweet or similar
No bullying or international politcs
Be excellent to each other.

founded 1 year ago

MODERATORS

[email protected]

1918

The dream (lemmy.world)

submitted 10 months ago by [email protected] to c/[email protected]

251 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 1 points 10 months ago (1 children)

wrong.

if that existed, all those AI server farms wouldn't be so necessary, would they?

dedicated hardware for that already exists, it definitely isn't gonna be able to fit a sizeable model on a phone any time soon. models themselves require multiple tens of gigabytes of storage space. you won't be able to fit more than a handful on even a 512gb internal storage. the phones can't hit the ram required for these models at all. and the dedicated hardware still requires a lot more power than a tiny phone battery.

[–] [email protected] 2 points 10 months ago

Those server farms are because the needs of corporations might just be different from the needs of regular users.

I'm running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.

It's almost as if technology can get better and more efficient over time.