Even if physical things have an intrinsic nature, I can't see how they could be aware of this nature without some mechanism designed to detect it. And any such mechanism would be fallible. This is the core of my worry about IIT. It assumes we have knowledge of a kind no physical system could have.