We argue against an impoverished understanding of exploration as serendipitous discoveries in existing datasets. We observe that exploration is often guided by theoretical assumptions. We further argue that good exploration exists and it needs to be thorough and systematic, rather than haphazard.