you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 3 months ago

Look at the enormous processing resources of biological brains. Human brain is 2% of body mass but 20% of baseline metabolism -- this is very expensive evolutionary. Neural hardware used for LLMs or just any scientific numerics accelerator is just a bad reinvention. Your argument reminds me of Minsky's "5 MIPS is enough for AI". Nope. You have to track a lot of state, its relationships and refresh it all very quickly. Computation is expensive.

  • source
  • parent