Is it redundant or just a different kind of information? Seems to me that what comes out of LLMs is amplitudes as much as frequencies, so to speak
I think probably the fact that what we perceive as vast stores of knowledge and understanding are able to be frozen into LLMs so easily just means that a lot of what we think is different stuff is, in practice, really just redundant repetition of the same stuff with different signage.

Comments