Worked again for Bluesky. It's either using knowledge of titles from its dataset, or it actually does have network access 🤔 - ThreadSky

About ThreadSky

carloslemus.bsky.social • 89 days ago

Worked again for Bluesky. It's either using knowledge of titles from its dataset, or it actually does have network access 🤔

Comments

simonwillison.net•89 days ago

That looks to me like it's using its knowledge - does that tool provide any kind of UI indication when it's actually executing code?

It should do: the ChatGPT and Claude UIs both have clear code execution visual hints, which is definitely the right design decision

carloslemus.bsky.social•89 days ago

No, I made the false assumption based on your blog that the Flash 2.0 backend itself executed some code. It does not. But it can infer what the output *would* be for a given piece of code. TIL

carloslemus.bsky.social•89 days ago

Worked for my own personal site too, which I doubt was used for LLM training, but perhaps I'm wrong.

simonwillison.net•89 days ago

Create a brand new web page with a random title and try it against that URL - even better, tail log files on a server to see if it gets a request (you can use a tool like this https://pipedream.com/requestbin)

carloslemus.bsky.social•89 days ago

No I think it's definitely using Google's massive dataset, because when I ask it to give me everything within the tag for my site, it gets it *kind of* right, but it hallucinates:

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply