you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 4 days ago (3 children)

The different LLMs do vary in abilities. What I find amazing is how bad Copilot is compared to any of the others. Not just on complex stuff, but basic requests. I've had local models do better, years ago.

  • source
  • parent
  • hideshow 6 child comments
  • IKR? For what it costs and for how hard Microsoft has worked to shoehorn it into everything, it offers very little in terms of increased productivity. I would go so far as to call it an epic failure. Especially considering they spent vast sums of money on it and all they managed to produce was something that is at best marginally good at drafting emails.

    As far as a coding assistant, Copilot is pathetic and produces code that is utter trash much of the time.

  • source
  • parent
  • [–] 2 points 4 days ago

    AFAIK compilot just provides integration with visual studio and GitHub, it doesn't have its own models. You pay through Microsoft to use use other companies' models (like GPT or Claude). Though agent harness itself has a big impact on the performance of models.

  • source
  • parent