You don’t need to disable dictation, it defaults to the last feature you used. So keep dictation on if you use it in other apps, and just send a voice memo and it should stick to that.