I'm unfamiliar with fish but that $'\003' also looks a lot like how bash escapes unprintable control characters (ASCII 3 is 'end of text' apparently).
You probably have sh or bash available. Try the same command in that.
sh -c "rm -rf 'folder'$'\003'"
Or just delete all directories that start with folder with confirmation (no -f):
rm -r folder*