36
Google Bard hallucinates a solar sail that travels "100 times the speed of light"
(media.kbin.social)
this post was submitted on 21 Jul 2023
36 points (100.0% liked)
Technology
12 readers
1 users here now
This magazine is dedicated to discussions on the latest developments, trends, and innovations in the world of technology. Whether you are a tech enthusiast, a developer, or simply curious about the latest gadgets and software, this is the place for you. Here you can share your knowledge, ask questions, and engage in discussions on topics such as artificial intelligence, robotics, cloud computing, cybersecurity, and more. From the impact of technology on society to the ethical considerations of new technologies, this category covers a wide range of topics related to technology. Join the conversation and let's explore the ever-evolving world of technology together!
founded 2 years ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm getting tired of repeating this but Language models are incapable of doing math. They generate text which has the appearance of a mathematical explanation, but they have no incentive or reason for it to be accurate.
Bing Chat is doing quite well:
I even asked Bing to calculate the time dilation for the person on earth. It answered correctly with the formula and steps shown clearly.
Then it was pulling its calculations directly from a web source, not using generative large language models. I'm not saying a chatbot can't do this, I'm saying language models can't do this.
Your failure in reasoning here is assuming that all of them are purely and only language models. That they receive no other source of learning other than language models -- for example, they aren't fed any kind of pop science math.
It's clear that this is true of models like ChatGPT, but isn't the Bing thing powered by GPT4 with a number of other enhancements? Fixing this "can't do math" thing is a low-hanging fruit for development improvements.
Apparently Bing Chat is able to do some maths. I asked Bing multiple variations of this question based on different speeds of the solar sail (e.g. what if it travels at 50% the speed of light). It was able to calculate both the travel time and the time dilation.
If it is only pulling the answer from web sources, how did it handle the variable speeds?
It's also possible that Bing's chatbot is using a math-specific plugin in addition to its websearching plugin.
They announced to build in plug ins like for WolframAlpha, so maybe that is where it is pulling this data from.
Just like how image models are incapable of doing language, and it ends up looking like nonsense words.
Precisely
Yeah, but it wasn’t a math question. Bard “decided” to make it a math question either way.
Hikaru Nakamura tried to play ChatGPT in a game of chess, and it started making illegal moves after 10 moves. When he tried to correct it, it apologized and gave the wrong reason for why the move was illegal, and then it followed up another illegal move. That's when I knew that LLM's were just fragile toys.
It is after all a Large LANGUAGE Model. There's no real reason to expect it to play chess.
There is. All the general media is calling these LLMs AI and AIs have been playing chess and winning for decades.
Yeah for that we'd need a Gigantic LANGUAGE Model.
You can get ChatGPT to play a much better game by telling it to display a representation of the current state of the board after each move, that way it doesn't lose track of where the pieces are as easily. But still, given that these LLMs were never specifically trained to play chess in the first place it's amazing how well they do. It'd be like if I set up a chessboard for my dog and 90% of the moves she made were actually valid, rather than simply knocking over all the pieces and then wagging her tail in expectation of the treat she thinks she's earned by doing so.
The issue here isn't the math, it's the claim that the solar sail will be traveling at 100 times the speed of light.
But 100 times IS math?
I call them "word calculators." They take input and generate output, but like a calculator if you don't know how to check the output you're gonna have a bad time
You fact check your calculator? Like with another calculator, or do you do it by hand?
I at least have an idea by estimating the result. If I do 10 x 20 and end up with 13.397897 I know something’s wrong.
Maybe you should have a language model repeat it for you. :)