The more desperately they attempt to fill LLMs with the total sum of human writing, the more it appears that computers *still* can't replicate the human brain in terms of linguistic output. Like, "we've given this dog a hammer and he still hasn't put up a shelf. Shall we add more hammers?" - ThreadSky

About ThreadSky

harecomedy.bsky.social • 40 days ago

The more desperately they attempt to fill LLMs with the total sum of human writing, the more it appears that computers *still* can't replicate the human brain in terms of linguistic output.

Like, "we've given this dog a hammer and he still hasn't put up a shelf. Shall we add more hammers?"

Comments

christophesmet.bsky.social•40 days ago

Also, there are actually three dogs and a lot of people are convinced that one of the dogs is a lot better at putting up shelves than the other ones.

kh0rish.bsky.social•40 days ago

It happened in this thread even

christophesmet.bsky.social•40 days ago

It did indeed. Poor llama.

simons-mith.bsky.social•40 days ago

Well, their mistake was right there in the first sentence. They actually filled them up with the /internet/. Even if you get an ideal LLM that simulates its inputs perfectly, the best you could possibly hope for is internet-level output.
...
Oh dear.

rho-9-systems.bsky.social•40 days ago

The hilarious part is, there's a good chance the reason the LLMs are so stupid is because they weren't trained for enough iterations,and is underfit. Research llama2 and mixtral 7B, they're both trained on the same data, but mixtral outperforms llama2, being trained longer, and using better methods.

rho-9-systems.bsky.social•40 days ago

weellllll nearly the same data

rhiannonrevolts.bsky.social•40 days ago

UKGov: let's invest in dog hammers

pairedfluorescent.bsky.social•40 days ago

I was told (and don't quote me on this, I don't understand tech) that part of the problem is they keep scraping the Internet. And not only is that obviously problematic, but it's also filling up with output from LLMs, which are then relearning from their own shitty materials

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply