this post was submitted on 02 Jul 2024
545 points (100.0% liked)

TechTakes

1489 readers
31 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 5 months ago* (last edited 5 months ago) (2 children)

The last part is absolutely false. The Nvidia H100 TDP is like 700W, though ostensibly configurable. The B200 is 1000W. The AMD MI300X is 750W.

They also skimp on RAM with many SKUs so you have to buy the higher clocked ones.

They run in insane power bands just to eek out a tiny bit more performance. If they ran at like a third of their power, I bet they would be at least twice as power efficient, and power use scales over nonlinearly with voltage/clock speed.

But no, just pedal to the metal. Run the silicon as hard as it can, and screw power consumption.

Other AI companies like Cerebras are much better, running at quite sane voltages. Ironically (or perhaps smartly), the Saudis invested in them.

[–] [email protected] 25 points 5 months ago (2 children)

Other AI companies like Cerebras are much better, running at quite sane voltages. Ironically (or perhaps smartly), the Saudis invested in them.

it’s real bizarre you edited this in after getting upvoted by a few people

[–] [email protected] 19 points 5 months ago (1 children)

banned them for the subtle spam attempt

[–] [email protected] 24 points 5 months ago

“it’s just lemmy, my reddit shit will work fine there” says meme stock marketer who’s never been subjected to any kind of scrutiny

[–] [email protected] -2 points 5 months ago (2 children)

You never post, second guess yourself, and research? Really easy to explain.

[–] [email protected] 18 points 5 months ago

I usually append them at the end of the comment preceded by "Edit:" for transparency.

[–] [email protected] 15 points 5 months ago (1 children)

do the results of your personal research frequently look like marketing horseshit?

[–] [email protected] 9 points 5 months ago* (last edited 5 months ago)

(notably posted at a 7min delta after the other comment with oh so specific details, and just entirely dismissing the man behind the curtain as to the plurality of compute involved)

[–] [email protected] 8 points 5 months ago

wow, exemplary performance