No one said he couldn't speak elvish. Just that it wasn't his mother tongue. That's what "...as a second language learner" means. That the person isn't a native speaker so they may sometimes be confused by phrases and think they are meant literally instead of as an idiom. Or they might confuse one meaning of a word for another. As someone who speaks another language, trust me when I say that it can be a constant problem.