The Torah does not say to love thy neighbor only if they are rich, straight, male, and white.
On the contrary, there are no qualifiers. We need to love all of our neighbors. No, it is not easy. You might have some fundamental differences with them, but still, you have to love them.