*removes a single neuron, destroying your ability to think* nothing personnel kid arxiv.org/abs/2411.07191 - ThreadSky

gracekind.net • 5 days ago

*removes a single neuron, destroying your ability to think* nothing personnel kid

https://arxiv.org/abs/2411.07191

Comments

steveread.bsky.social•4 days ago

📌

jurgisbekepuris.bsky.social•4 days ago

I wonder if this works on humans too

jbarbosa.org•4 days ago

Why would it?

jurgisbekepuris.bsky.social•4 days ago

Let's cut some neural pathways and find out.

jbarbosa.org•4 days ago

It's not a pathway, it's a single synapse

jurgisbekepuris.bsky.social•4 days ago

Works for me.

nixjeelvy.bsky.social•4 days ago

No, thank heavens. Otherwise we wouldn't be able to drink beer.

flakywanderer.bsky.social•5 days ago

How does this not end up completely obliterating training accuracy due to dropout

jdp.extropian.net•4 days ago

I think it's increasingly popular to not use dropout in large training runs.

timkellogg.me•4 days ago

when Jeff Dean did Dwarkesh he said it hasn’t even been tried, for the most part

but also that’s why he’s not worried about data availability, even simple stuff like dropout hasn’t been tried

jebediah98.bsky.social•4 days ago

They didn’t try dropout?

timkellogg.me•4 days ago

that, or no one’s had enough success with it to talk about it

menger-spongebob.bsky.social•5 days ago

i thought regularisaton was supposed to prevent this

dulanyw.bsky.social•5 days ago

[Reaching max LLM compression by deleting everything except The Really Good Weight]

akhilrao.bsky.social•5 days ago

[Reaching max LLM transferability by finding The Platonic Weight]

sichulu.bsky.social•4 days ago

https://www.biorxiv.org/content/10.1101/2020.05.05.079038v1

tedunderwood.me•4 days ago

That’s very cool

sichulu.bsky.social•4 days ago

The one neuron to rule all of weight space

sichulu.bsky.social•4 days ago

Out out damned spot, for is this an alignment strategy I see before me

sudo-lindenberg.bsky.social•4 days ago

📌

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply