428
China scientists develop flash memory 10,000× faster than current tech (interestingengineering.com)
submitted 1 year ago by to c/technology@lemmy.world
110 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 1 year ago (8 children)

You can get a Coral TPU for 40 bucks or so.

You can get an AMD APU with a NN-inference-optimized tile for under 200.

Training can be done with any relatively modern GPU, with varying efficiency and capacity depending on how much you want to spend.

What price point are you trying to hit?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 8 points 1 year ago (6 children)

    What price point are you trying to hit?

    With regards to AI?. None tbh.

    With this super fast storage I have other cool ideas but I don't think I can get enough bandwidth to saturate it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 0 points 1 year ago

    With regards to AI?. None tbh.

    TBH, that might be enough. Stuff like SDXL runs on 4G cards (the trick is using ComfyUI, like 5-10s/it), smaller LLMs reportedly too (haven't tried, not interested). And the reason I'm eyeing a 9070 XT isn't AI it's finally upgrading my GPU, still would be a massive fucking boost for AI workloads.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -2 points 1 year ago (4 children)

    You’re willing to pay $none to have hardware ML support for local training and inference?

    Well, I’ll just say that you’re gonna get what you pay for.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 9 points 1 year ago (3 children)

    No, I think they're saying they're not interested in ML/AI. They want this super fast memory available for regular servers for other use cases.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 1 year ago (2 children)

    Precisely.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 1 year ago (1 child)

    I have a hard time believing anybody wants AI. I mean, AI as it is being sold to them right now.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 1 year ago

    I mean the image generators can be cool and LLMs are great for bouncing ideas off them at 4 AM when everyone else is sleeping. But I can't imagine paying for AI, don't want it integrated into most products, or put a lot of effort into hosting a low parameter model that performs way worse than ChatGPT without a paid plan. So you're exactly right, it's not being sold to me in a way that I would want to pay for it, or invest in hardware resources to host better models.

  • permalink
  • fedilink
  • source
  • parent