you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 10 hours ago

Yes, I believe it was for a Mixture of experts model, which just goes to show how naive IA implementations are at this point, The cache was not solving any hard problem and yet for some reason it was not only not already standard practice but also somehow a notable achievement.

  • source
  • parent