764
Google Gemini struggles to write code, calls itself “a disgrace to my species” (arstechnica.com)
submitted 1 year ago by to c/technology@lemmy.world
163 comments fedilink hide all child comments
 

Or my favorite quote from the article

"I am going to have a complete and total mental breakdown. I am going to be institutionalized. They are going to put me in a padded room and I am going to write... code on the walls with my own feces," it said.

you are viewing a single comment's thread
view the rest of the comments
[–] 28 points 1 year ago (8 children)

Honestly, Gemini is probably the worst out of the big 3 Silicon Valley models. GPT and Claude are much better with code, reasoning, writing clear and succinct copy, etc.

  • permalink
  • fedilink
  • source
  • hideshow 8 child comments
    •
  • [–] 9 points 1 year ago (2 children)

    Could an AI use another AI if it found it better for a given task?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 4 points 1 year ago

    Yes, and this is pretty common with tools like Aider — one LLM plays the architect, another writes the code.

    Claude code now has sub agents which work the same way, but only use Claude models.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 1 year ago

    The overall interface can, which leads to fun results.

    Prompt for image generation then you have one model doing the text and a different model for image generation. The text pretends is generating an image but has no idea what that would be like and you can make the text and image interaction make no sense, or it will do it all on its own. Have it generate and image and then lie to it about the image it generated and watch it just completely show it has no idea what picture was ever shown, but all the while pretending it does without ever explaining that it's actually delegating the image. It just lies and says "I" am correcting that for you. Basically talking like an executive at a company, which helps explain why so many executives are true believers.

    A common thing is for the ensemble to recognize mathy stuff and feed it to a math engine, perhaps after LLM techniques to normalize the math.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 4 points 1 year ago* (4 children)

    I always hear people saying Gemini is the best model and every time I try it it’s… not useful.

    Even as code autocomplete I rarely accept any suggestions. Google has a number of features in Google cloud where Gemini can auto generate things and those are also pretty terrible.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 3 points 1 year ago (3 children)

    I don’t know anyone in the Valley who considers Gemini to be the best for code. Anthropic has been leading the pack over the year, and as a results, a lot of the most popular development and prototyping tools have been hitching their car to Claude models.

    I imagine there are some things the model excels at, but for copy writing, code, image gen, and data vis, Google is not my first choice.

    Google is the “it’s free with G suite” choice.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 2 points 1 year ago (2 children)

    There’s no frontier where I choose Gemini except when it’s the only option, or I need to be price sensitive through the API

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 1 year ago (1 child)

    Interesting thing is that GPT 5 looks pretty price competitive with . It looks like they’re probably running at a loss to try to capture market share.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 1 year ago

    I think Google’s TPU strategy will let them go much cheaper than other providers, but its impossible to tell how long they last and how long it takes to pay them off.

    I have not tested GPT5 thoroughly yet

  • permalink
  • fedilink
  • source
  • parent