It does matter... It reflects the old patrist tendencies of the old ways of doing things... If we're going into comparisons, really women have irrelevant places in most LHP organizations the exception currently being The Temple of Set, who has had a female High Priestess. However, she is like the only one since 1974 if I am not mistaken... I find it ridiculous that 49.6% of the world population is disqualified to lead a LHP organization by virtue of their genitalia... But, that's how I see it...
If one cannot embrace egalitarianism one cannot evolve past the chimp-like stage we came from a couple of million years ago. The difference is we, as humans, have a choice. We can decide to be petty, sexist, or racist... or any other type of "ist' you can imagine, but these things are toxic to ones mind. It never seems to me that most people associating with these terms are very happy... I think that is generally the best gauge of whether ones path is correct or right... Seconded by the possibility that it is also making others nearby happy, or wiser!