you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 4 months ago

But the benchmarks are semi useless. Performance at new problems in your precise use case matter and that's only something one can find out you using it. This can differ wildly from what benchmarks suggest. AI can be an ability enhancer when for example someone who has no idea hos to code suddenly manages to create crappy code but that manages to do a job where for example success can be easily verified. But if the result should ve good or even reliable ... well....

  • source
  • parent