TIL modern LLMs are practically identical (minus some math and scale) to the mechanical perceptron invented in 1958 🤯 Even back propagation has been around since 1986. It's like a jigsaw puzzle slowly (compared to today) slotting into place until the 2020 magnum opus
https://youtu.be/l-9ALe3U-Fg?si=MxtTksZaPGDFCI5B