Profile avatar
catforgetter.bsky.social
cellular, modular, interactivodular
62 posts 80 followers 527 following
Regular Contributor
Active Commenter

Self-Assembly of a Biologically Plausible Learning Circuit https://arxiv.org/abs/2412.20018

Hyperdimensional computing, inspired by cognition, is a framework where the primitives are high-dimensional vectors. It sits somewhere between symbolic and connectionist AI. Some basic examples: www.dissonances.blog/p/computing-...

merry christmas everyone

Apropos of never ending discussions about whether ANNs are "good" models of the nervous system, here is a slide I present to masters students showing a network that is found in motor control circuits *across phyla* (that's pretty ubiquitous!) I ask them to guess what it does...

master's degree finished, time to get a job again I guess. the good news is that I think I lost my most recent resume when I accidentally overwrote the wrong partition during a Linux install last year (please hire me, I'm good at computers). the most recent one I found is almost 4 years old

"average validation video has 25% errors" factoid actually statistical error. errors_georg.avi, which is 1000 frames long and almost entirely misclassified, is an outlier and should not have counted

it's a bad look for bluesky moderation, IMO, that this guy got banned for "trolling". new app idea: bluesky, but with decentralized moderation

repetition legitimizes

gifsmos.com is pretty cool.

Overleaf has a popup preview for math now and I am enjoying it

we do a little bifurcating

was looking for an introductory reference on path integrals, and I might read this book just for the cover alone. I must know what it means for Norbert Wiener to be the Sancho Panza of path integrals

some of you researchers are unhinged

I think this "brute force is all you need" mindset is going to end up looking pretty silly

I've always found the \big, \Big, \bigg, \Bigg progression in LaTex unintuitive. clearly it should just be \big, \bigg,\biggg, \bigggg, ...

finally got a predictive coding RL agent kinda working on Cart Pole. no target network, though I only got to 500 reward with one random seed, and out of 5 seeds I tried, only one other seed got above 200 💀. next up: proper tuning experiments

in terms of papers for which both (1) I've tried to implement, and (2) there's source code available, i'm currently at 4 of 4 of them having source code not matching the paper description.

so this is where we're at, as a society. we're doing python code in YAML files now

Is Spiritbox a Djent? Is John Coltrane a Jazz? Is Bach a Baroque?

reading through this today: "Inferring neural activity before plasticity as a foundation for learning beyond backpropagation" www.nature.com/articles/s41... still reading, but my initial take away is good use of pictures

the multivariate Gaussian section of PRML is really exposing all the linear algebra I've forgotten. as far as I can tell, this "simple rearrangement" involves using the cyclic property of the trace operator. had to use ChatGPT and then google to figure this out

doing a little hyperbolic rotation this morn www.desmos.com/calculator/9...

my rabbit neighbors were busy last night

"LLMs prompt us" ಠ_ಠ

a symbolic deduction engine and brute force is all you need: "Using highly parallelized computing, the system started by generating one billion random diagrams of geometric objects and exhaustively derived all the relationships between the points and lines in each diagram."

3 months back in illinois after 5.5 years in florida, and I'm finally experiencing a proper midwestern winter again

decided to have a bit of solanine poisoning tonight, as a treat. i previously ate one other potato in this same batch and it was fine, so I guess I wasn't paying close enough attention!