from language "no meaning from form alone". Since LLM's can often speak meaningfully, there is a paradox. My resolution is to say llm's do capture some semantics in the foundation model by compressing input down to a neat vector based semantic model. ("distributional semantics")

Comments