"Chat GPT told me that it *can't* alter its data set but it did say it could simulate what it would be like if it altered it's data set" NO. It has no idea if it's telling the truth or not and when it says "I can simulate what this would be like" This guy is pretty sharp about philosophy but […] - ThreadSky

futurebird.sauropods.win.ap.brid.gy • 5 days ago

"Chat GPT told me that it *can't* alter its data set but it did say it could simulate what it would be like if it altered it's data set"

NO. It has no idea if it's telling the truth or not and when it says "I can simulate what this would be like"

This guy is pretty sharp about philosophy but […]

Comments

llewelly.sauropods.win.ap.brid.gy•4 days ago

@futurebird a fine example of why "oh, we'll have humans in the loop checking what our bullshit machine does" is fraud; even many smart people are easily fooled by these bullshit machines.

davep.infosec.exchange.ap.brid.gy•5 days ago

@futurebird "It provided a statistically probable stream of tokens" just doesn't have the same ring

futurebird.sauropods.win.ap.brid.gy•4 days ago

I apologize for the edits. I should probably not post when annoyed. LOL.

futurebird.sauropods.win.ap.brid.gy•5 days ago

Chat GPT will say things if you ask it what it did, the answers will be similar to texts it has processed about describing how things are done, some in the context of describing how a computer program might do something.

It might even give you a good run down of how LLMs work mixed in there […]

dalias.hachyderm.io.ap.brid.gy•5 days ago

@futurebird I think a lot of people are really bad at reasoning about this kind of thing* in general, even before LLMs, and the LLMentalist effect on top of that really sucks them in.

* = multi-layer self-referential language about provenance of language, epistemology, etc.

dalias.hachyderm.io.ap.brid.gy•5 days ago

@futurebird I kinda think the best mental model normies (non-mathematicians/logicians) can easily grasp for LLMs is a cheating partner. For every thing you say, it's going to gaslight you with the most plausible sounding response it can come up with. None of these responses necessarily have […]

futurebird.sauropods.win.ap.brid.gy•5 days ago

@dalias

Maybe but that still implies some kind of organization of concepts beyond just through language or the shape of their output.

I don't see any reason why it should be impossible to design a program with concepts, that could do something like reasoning ... you might even use an LLM to […]

dalias.hachyderm.io.ap.brid.gy•5 days ago

@futurebird Right, the purpose of the metaphor is as a mnemonic device for the goal.

futurebird.sauropods.win.ap.brid.gy•5 days ago

Half a million views and from a day ago. Good lord.

futurebird.sauropods.win.ap.brid.gy•5 days ago

When photography was invented many people thought it might capture the human soul... and that's about how this will sound some day.

Comments

Posting Rules

Reply