Forgive me.
I don't believe you did intend your statement to be gender-specific: it just was. While males are supposed to be more violent than females, women are believed to be more emotionally manipulative. Thus to say physical violence is always accompanied by psychological harm, implies males do twice the damage than females who only inflict mental injury.