You're not overreacting.
You're not being impolite.
And you are not "failing to see things from both sides."
Don't be gaslit into tolerating their intolerance. You have an obligation to provide social consequences for intolerable behavior.
America, let's get our Nazi problem in order.