you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 4 months ago (1 child)

Then 'RAG' allowed the AI to read parts of your codebase and maybe even do a google search.

I'm sure it's reassuring to know that the entire process isn't just having the AI talk to itself nonstop and that it does reach out to get opinions from a second AI from time-to-time.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 4 months ago

    Often they do that within the model's architecture itself. You can save drastically on the filesize of the model itself by using this Mixture of Experts (MoE) strategy. Its how deepseek was able to break into the market.

  • source
  • parent