Misogyny is a system of violence and discrimination against women as a class across all levels of society. Like homophobia against gay people as a class, racism against racial minorities as a class, and so on.

And a power structure is to the benefit of the ruling class. The ruling class is not systematically discriminated against and would not allow any systematic discrimination against them. So there is no systemic discrimination against the ruling class. The ruling class is composed of white heterosexual cisgender men, and there are no power structures against them on.