Yeah. There's a rich history of argumentation about this topic. Player skill vs. PC skill, etc. I fall strongly center on the matter. Basically, use the rolls where needed and don't use them where not needed.

The "where needed" part does most of the lifting here.