Harming others

Is it OK to harm a few in order to benefit others?

Swearing

You swear.

I don't mind swearing.

My Mother does mind.

Do I ask you not to swear in front of her?

Is such an action an infringement of the Golden Rule?