I try not to make big sweeping changes between playtests too often because then I might not find the actual problem. I need something as a "test" case, and tweak the variables.

That isn't to say I'm afraid to dump something if it's not working. If an aspect is a problem multiple times get it out!