63
submitted 1 day ago by [email protected] to c/[email protected]
top 28 comments
sorted by: hot top new old
[-] [email protected] 10 points 15 hours ago* (last edited 14 hours ago)

It’s funny how the article asks the question, but completely fails to answer it.

About 15 years ago, Nvidia discovered there was a demand for compute in datacenters that could be met with powerful GPU’s, and they were quick to respond to it, and they had the resources to focus on it strongly, because of their huge success and high profitability in the GPU market.

AMD also saw the market, and wanted to pursue it, but just over a decade ago where it began to clearly show the high potential for profitability, AMD was near bankrupt, and was very hard pressed to finance developments on GPU and compute in datacenters. AMD really tried the best they could, and was moderately successful from a technology perspective, but Nvidia already had a head start, and the proprietary development system CUDA was already an established standard that was very hard to penetrate.

Intel simply fumbled the ball from start to finish. After a decade of trying to push ARM down from having the mobile crown by far, investing billions or actually the equivalent of ARM’s total revenue. They never managed to catch up to ARM despite they had the better production process at the time. This was the main focus of Intel, and Intel believed that GPU would never be more than a niche product. So when intel tried to compete on compute for datacenters, they tried to do it with X86 chips, One of their most bold efforts was to build a monstrosity of a cluster of Celeron chips, which of course performed laughably bad compared to Nvidia! Because as it turns out, the way forward at least for now, is indeed the massively parralel compute capability of a GPU, which Nvidia has refined for decades, only with (inferior) competition from AMD.

But despite the lack of competition, Nvidia did not slow down, in fact with increased profits, they only grew bolder in their efforts. Making it even harder to catch up.

Now AMD has had more money to compete for a while, and they do have some decent compute units, but Nvidia remains ahead and the CUDA problem is still there, so for AMD to really compete with Nvidia, they have to be better to attract customers. That’s a very tall order against Nvidia that simply seems to never stop progressing. So the only other option for AMD is to sell a bit cheaper. Which I suppose they have to.

AMD and Intel were the obvious competitors, everybody else is coming from even further behind. But if I had to make a bet, it would be on Huawei. Huawei has some crazy good developers, and Trump is basically forcing them to figure it out themselves, because he is blocking Huawei and China in general from using both AMD and Nvidia AI chips. And the chips will probably be made by Chinese SMIC, because they are also prevented from using advanced production in the west, most notably TSMC. China will prevail, because it’s become a national project, of both prestige and necessity, and they have a massive talent mass and resources, so nothing can stop it now.

IMO USA would clearly have been better off allowing China to use American chips. Now China will soon compete directly on both production and design too.

[-] [email protected] 41 points 1 day ago

How to create a successful GPU company in 2025:

  • Step 1: build a time machine and go back 30 years
[-] [email protected] 2 points 1 day ago

What do i do before I did that?

[-] [email protected] 7 points 1 day ago* (last edited 1 day ago)

Have rich parents, pale skin, etc.

[-] [email protected] 2 points 1 day ago

No that comes afterwards

[-] [email protected] 14 points 1 day ago

At first I was going to say there is ATI. Then I realized I hadn't heard about ATI in a while and looked up what happened to it. Then I realized... I'm old.

[-] [email protected] 56 points 1 day ago

What a shit article. Doesn't explain the software situation. While CUDA is the most popular, a lot of frameworks do support AMD chips.

[-] [email protected] 18 points 1 day ago

A comically bad "article".

[-] [email protected] 8 points 1 day ago

Naji said the firm has also “developed the broadest ecosystem” of developers and software.

“And so it's just so much easier to … build an application, build an AI model on top of those chips,” he said.

[-] [email protected] 15 points 1 day ago

Expounding, Nvidia has very deeply engrained itself in educational and research institutions. People learning GPU compute are being taught CUDA and Nvidia hardware. Researchers have access to farms of Nvidia chips.

AMD has basically gone the "build it and they will come" attitude, and the results to match.

[-] [email protected] 9 points 1 day ago* (last edited 1 day ago)

AMD has basically gone the “build it and they will come” attitude

Except they didn't.

They repeatedly fumble the software with little mistakes (looking at you, Flash Attention). They price the MI300X, W7900, and any high VRAM GPU through the roof, when they have every reason to be more competitive and undercut Nvidia. They have sad, incomplete software efforts divorced from what devs are actually doing, like their quantization framework or some inexplicably bad LLMs they trained themself. I think Strix Halo is the only GPU compute thing they did half right recently, and they still screwed that up.

They give no one any reason to give them a chance, and wonder why no one comes. Lisa Su could fix this with literally like three phone calls (remove VRAM restrictions on their OEMs, cut pro card prices, fix stupid small bugs in ROCM), but she doesn't. It's inexplicable.

[-] [email protected] 6 points 1 day ago* (last edited 1 day ago)

That's basically what I said in so many words. AMD is doing its own thing, if you want what Nvidia offers you're gonna have to build it yourself. WRT pricing, I'm pretty sure AMD is typically a fraction of the price of Nvidia hardware on the enterprise side, from what I've read, but companies that have made that leap have been unhappy since AMD's GPU enterprise offerings were so unreliable.

The biggest culprit from what I can gather is that AMD's GPU firmware/software side is basically still ATI camped up in Markham, divorced from the rest of the company in Austin that is doing great work with their CPU-side.

[-] [email protected] 2 points 1 day ago* (last edited 1 day ago)

WRT pricing, I’m pretty sure AMD is typically a fraction of the price of Nvidia hardware on the enterprise side

I'm not as sure about this, but seems like AMD is taking a fat margin on the MI300X (and its sucessor?), and kinda ignoring the performance penalty. It's easy to say "build it yourself!" but the reality is very few can, or will, do this, and will simply try to deploy vllm or vanilla TRL or something as best they can (and run into the same issues everyone does).

The 'enthusiast' side where all the university students and tinkerer devs reside is totally screwed up though. AMD is mirroring Nvidia's VRAM cartel pricing when they have absolutely no reason to. It's completely bonkers. AMD would be in a totally different place right now if they had sold 40GB/48GB 7900s for an extra $200 (instead of price matching an A6000).

The biggest culprit from what I can gather is that AMD’s GPU firmware/software side is basically still ATI camped up in Markham, divorced from the rest of the company in Austin that is doing great work with their CPU-side.

Yeah, it does seem divorced from the CPU division. But a lot of the badness comes from business decisions, even when the silicon is quite good, and some of that must be from Austin.

[-] [email protected] 3 points 1 day ago* (last edited 1 day ago)

The ‘enthusiast’ side where all the university students and tinkerer devs reside is totally screwed up though. AMD is mirroring Nvidia’s VRAM cartel pricing when they have absolutely no reason to. It’s completely bonkers. AMD would be in a totally different place right now if they had sold 40GB/48GB 7900s for an extra $200 (instead of price matching an A6000).

Eh, the biggest issue here is that most (post-secondary) students probably just have a laptop for whatever small GPGPU learning they're doing, which is overwhelmingly dominated by Nvidia. For grad students they'll have access to the institution resources, which is also dominated by Nvidia (this has been a concerted effort).

Only a few that explicitly pursue AMD hardware will end up with it, but that also requires significant foundational work for the effort. So the easiest path for research is throw students at CUDA and Nvidia hardware.

Basically, Nvidia has entrenched itself in the research/educational space, and that space is slow moving (Java is still the de facto CS standard, with only slow movements to Python happening at some universities), so I don't see much changing, unless AMD decides it's very hungry and wants to chase the market.

Lower VRAM prices could help, but the truth is people and intuitions are willing to pay more (obviously) for plug and play.

[-] [email protected] 2 points 1 day ago* (last edited 1 day ago)

I dunno. From my more isolated perspective on GitHub and small LLM testing circles, I see a lot of 3090s, 4090s, sometimes arrays of 3060s/3090s or old P40s or MI50s, which people got basically for the purpose of experimentation and development because they can't drop (or at least justify) $5K.

They would 100% drop that money on at least one 7900 48GB instead (as the sheer capacity is worth it over the speed hit and finickiness), and then do a whole bunch of bugfixing/testing on them. I know I would. Hence the Framework Strix Halo thing is sold out even though it's... rather compute-lite compared to a 3090+ GPU.

It seems like a tiny market, but a lot of the frameworks/features/models being developed by humble open source devs filter up to the enterprise space. You'd absolutely see more enterprise use once the toolkits were hammered out on desktops... But they aren't, because AMD gives us no incentive to do so. A 7900 is just not worth the trouble over a 3090/4090 if its VRAM capacity is the same, and this (more or less) extends up and down the price ranges.

[-] [email protected] 8 points 1 day ago

It's literally the most surface level take. Does not even mention what CUDA is or AMD's efforts to run it

https://www.xda-developers.com/nvidia-cuda-amd-zluda/

But it is no longer funded by AMD or Intel

AMD GPUs are still supported by frameworks like PyTorch

https://rocm.docs.amd.com/projects/install-on-linux/en/latest/install/3rd-party/pytorch-install.html

While Nvidia might be the fastest, they are not always the cheapest option, especially if you rent it in the cloud. When I last checked, it was cheaper to rent AMD GPUs

[-] [email protected] 5 points 1 day ago

Do gamers even care about CUDA?

[-] [email protected] 14 points 1 day ago
[-] [email protected] 2 points 1 day ago

I thought this was about Nvidia not having competition.

[-] [email protected] 1 points 19 hours ago

It is, but it does have competition

[-] [email protected] 1 points 14 hours ago* (last edited 14 hours ago)

AFAIK the competition is mostly AMD, but AMD is not near Nvidia in popularity for AI or in datacenters in general, even if they may be offering reasonable value.
AMD is not nearly giving the competition to Nvidia they do to Intel. They are working on it, and I think they can take some marketshare. But for now AMD has sold mostly based on Nvidia not having allocated enough production to satisfy the market.
AMD also isn't anywhere near Nvidia in profits or profit margins, and that's a major parameter in estimating the level of competition they can provide.

[-] [email protected] 0 points 1 day ago

I'm a gamer, and I do...

Then again, I'm mostly excited about using CUDA cores for cracking hashes and the like, lol.

[-] [email protected] 19 points 1 day ago

Corporate consolidation and monopoly/oligopoly is usually why.

[-] [email protected] 11 points 1 day ago

Because why would AMD compete with them in any meaningful way?

It's the same as having 2 gas stations directly across the street from each other.

Neither one is there to compete with the other. They're both there to collectively rip off everyone else.

[-] [email protected] 11 points 1 day ago

Because its competitors care about Not Invented Here instead of building common industry standards.

[-] [email protected] 6 points 1 day ago

Well, Intel tried with OneApi. As for AMD they go 5 minutes between every time they shoot themselves in the foot. It's unbelievable to watch.

[-] [email protected] 4 points 1 day ago

Intel tried with OpenAPI because ROCm was not invented here.

[-] [email protected] -3 points 1 day ago

People like youz starts snoopin' around askin' questions tends to fall outta windows, y'know what I'm sayin'?

this post was submitted on 30 May 2025
63 points (80.0% liked)

Technology

70461 readers
3208 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS