This entire thread is a bit stupid because to some degree it overstates how unpredictable and shitty GenAI is, and how little control the devs have. But I think we really need to start thinking about the wizard behind the curtain as the person we’re talking about handing scientific thinking over to. - ThreadSky

colincarlson.bsky.social • 6 days ago

This entire thread is a bit stupid because to some degree it overstates how unpredictable and shitty GenAI is, and how little control the devs have. But I think we really need to start thinking about the wizard behind the curtain as the person we’re talking about handing scientific thinking over to.

Comments

gidmk.bsky.social•5 days ago

Yes, I would not be surprised for scientists to come up with various ways to ensure that their grants are accepted that involve manipulating the GenAI to some extent.

colincarlson.bsky.social•6 days ago

Tl;dr: the computer isn’t doing the thinking for you, it’s a guy named Jeff who taught a microwave to speak English. Why are we talking about letting Jeff decide which cancer drugs we invest in. Don’t do that. There’s no reason to think that would be good

bornat3b.bsky.social•6 days ago

We have not eliminated bias in human systems. Why for a second would we think that bias will be eliminated in systems designed by humans?

dogengineer.bsky.social•5 days ago

And trained on biased human data, anything really potentially transformative would be rejected

bornat3b.bsky.social•5 days ago

Exactly.

colincarlson.bsky.social•6 days ago

Alternatively: take an LLM that contains the entirety of anything ever written on Reddit, the YouTube comment section, and worse places. Sure, Jeff told the computer not to swear. But do you want a grant review written by the guys who wrote those posts in the training data?

colincarlson.bsky.social•6 days ago

You invite Jeff to serve as a grant panelist. He says “hey, this is too much work, so I decided to write a little script and count how many times each proposal used my favorite 20 words, and those are my scores.” Would you not simply bean Jeff on the head with a closed fist or perhaps a heavy book?

colincarlson.bsky.social•6 days ago

Anyway, science should be for the people who love the work.

applefarmer.bsky.social•5 days ago

Thank you for this thread. I get so tired of the AI cult acting like it's a real answer to any question.

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply