The added thickness of the primer can sometimes cause issues fitting pieces together, and the bonds you get when glueing painted plastic aren't as strong as bare plastic.
I also find it easier to clean up mould lines and sprue gates after removal from the sprue and before priming.