imagine an ant which lives on a map of your hometown. there are many things which you know about your hometown which that ant can never learn. but it is not the case that the ant living on that map knows nothing about your hometown.
Reposted from
Prof. Ian Walker
Large language models make me think of cargo cults. The belief is that by creating strings of words that superficially look like those created by intelligence, intelligence will later magically appear
Or, in Chomsky terms, it's the belief that by aping surface structure, deep structure will appear
Or, in Chomsky terms, it's the belief that by aping surface structure, deep structure will appear
Comments
But math *is* meaning! It's one representation of reality! And the same is true with language!
The fact that this seems to approximate a sort of knowledge and information processing engine when run through sufficient promptings is *actually fascinating* and raises questions about language itself!
Human language is loosely formal, but the it serves the same purpose to represent the human condition, which is inherently thought-bound.
Interesting thread.
1) the ants "do math" when they solve path optimization problems, thus are collectively intelligent
2) intelligence cannot exist in any form
Still not zero.
Limits of the analogy?