Technology

59232 readers

4217 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

255

Mark Zuckerberg indicates Meta is spending billions of dollars on Nvidia AI chips (www.cnbc.com)

submitted 9 months ago by [email protected] to c/[email protected]

51 comments fedilink hide all child comments

Summary: Meta, led by CEO Mark Zuckerberg, is investing billions in Nvidia's H100 graphics cards to build a massive compute infrastructure for AI research and projects. By end of 2024, Meta aims to have 350,000 of these GPUs, with total expenditures potentially reaching $9 billion. This move is part of Meta's focus on developing artificial general intelligence (AGI), competing with firms like OpenAI and Google's DeepMind. The company's AI and computing investments are a key part of its 2024 budget, emphasizing AI as their largest investment area.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 3 points 9 months ago (1 children)

Yeah, those GPU estimates are probably correct.

I specialized in ML during grad school, but only recently got back into it and keeping up with the latest developments. Started working at a startup last year that uses some AI components (classification models, generative image models, nothing nearly as large as GPT though).

Pessimistic about the AGI timeline :) Though I will admit GPT caught me off guard. Never thought a model simply trained to predict the next word in a sequence of text would capable of what GPT is (that's all GPT does BTW, takes a sequence to text and predicts what the next token should be, repeatedly). I'm pessimistic because, AFAIK, there isn't really a ML/AI architecture or even a good theoretical foundation that could achieve AGI. Perhaps actual brain simulation could, but I'm guessing that is very inefficient. My wild-ass-guess is AGI in 20 years if interest and money stays consistent. Then ASI like a year after, because you could use the AGI to build ASI (the singularity concept). Then the ASI will turn us into blobs that cannot scream, because we won't have mouths :)

[–] [email protected] 0 points 9 months ago

Yea I had a feeling it was still a long way away. At least the media will get bored of it in a year and only the big breakthroughs will make it.

But I think there will still be a lot of "stupid" yet impressive developments like GPT. It appears smart but isn't that smart. Sure there will be other things.

It's the same as the manufacturing developments. Only now are we beginning to build things similar to the complexity of a human in limited functions. But that doesn't mean the machines we have built haven't put millions of people out of work, we just changed manufacturing to better utilise the stupid things they can do much faster and accurately than we can and made a better product because of it. I found out about a year ago we couldn't make a Saturn v rocket now even if we had all the money in the world. The ability of man has been lost. The way they did the machining of the rockets and the welding and things like that, no one alive has that ability anymore. Robots can't do it either. But the rockets we make now are more accurate that the ones made in the 60's. It's just done differently.