I know that feeling lol.
I have a love/hate relationship with my Google speaker. Some examples that have happened:
"Hey google, set the temperature to 21 degrees"
google: "Sure. Setting the heater to 71 degrees!"
And
me: hey google, start a timer for ten minutes
google: okay, starting a 10 minute timer
me: perfect
google: okay, consider it cancelled
me: ...