I'm sure you have at some time cared about something that doesn't directly impact you. It's like that.

The reason it matters is because people are being murdered for being trans and queer. Your disregard and disrespect is what the murderers take as fodder to build up their violence and hatred.