There is definitely something to what you say. There have been experiments (NL of course) in removing traffic signs from some areas; the idea being if drivers have to observe and react to conditions instead of assuming permission to proceed they will behave more safely.