I think people forget that language isn't a natural phenomenon, it is a collaboratively built tool. Every useful or interesting aspect of LLMs is because they imitate language.

Similarly, checklists reduce hospital mistakes but that doesn't make one a doctor