There's an overarching storyline with some timey-wimey bits that I read at one point and have since forgotten. I haven't played all of them so maybe there are continuity assumptions elsewhere but both of the n64 titles can be played without knowing anything else about the series. MM complements OoT, but even they don't have to be played in release order to be appreciated.