Because he already lost not just his family, but his ENTIRE village right before his eyes, so he knows that if he got close to others, how much it would hurt to lose them, and he didn't want to deal with that again, though some people persisted and ended up his closest friends and allies. +