How dumbfounded people who are usually allowed to walk all over others' boundaries are all of a sudden, when somebody sets them a clear boundary.

Please, if you can, don't let people get away with being insulting and abusive, because "it's just how they are". Not everyone can defend themself.