“patriarchy” in this context means something other than you think, I.e. it means a system that upholds gender roles that benefit a (majority male) ruler class, e.g. by encouraging worker class men to go to war for their benefit, worker class women to be caretakers, and so on.
The counterpart to this definition of “patriarchy” is a society with no stratified gender roles, not “matriarchy”.