E.g. using the HMM-idea from your previous paper

Very cool paper! I have been studying a similar task with ambiguous data (but in the original grokking setting). I have been wondering if one can predict the behaviour of the model from the (early stages of) training only and without knowing of the distribution of the data

this is how it can go in pure math :x