i think the real error was that you started the echo with a double quote and ended with a single quote. had you properly wrapped it with single quotes it would have worked. even if you had escaped the double quote, there still would have been an error because you'd have a multi-line string with no ending "
(the 2nd double quote was properly escaped so that would not have terminated your string)
Also, you didn't escape your slashes.
Either it should have looked like this:
echo '# FYI quotes(") must be escaped with \ like \"'
or this:
echo "# FYI quotes(\") must be escaped with \\ like \\\""