The emerging story from mech interp research suggests that they do rely on structured reasoning mechanisms (induction heads, function vectors, binding IDs etc) but definitely lots of unknowns still about how they solve these kinds of problems and how that compares to humans.
Comments