Human behavior happens at a surprisingly slow 10 bits/second or so, even though our sensory systems gather 8 orders of magnitude more data. Plus, we can only think about one thing at a time. We don’t know why
(In LLM terms, human behavior happens at less than a token/sec). https://arxiv.org/abs/2408.10234
(In LLM terms, human behavior happens at less than a token/sec). https://arxiv.org/abs/2408.10234
Comments
(I suppose the difference is that real-world text is predictable and contains much less information than it would if every token was random and independent)
So of course I asked ChatGPT and went down such an interesting rabbit.