This post by @simon makes a very smart point about hallucinations, but the best part might be this section at the end, full of helpful tips that most people generally have to learn through trial and error. https://simonwillison.net/2025/Mar/2/hallucinations-in-code/ - ThreadSky

About ThreadSky

mergesort.macaw.social.ap.brid.gy • 1 day ago

This post by @simon makes a very smart point about hallucinations, but the best part might be this section at the end, full of helpful tips that most people generally have to learn through trial and error.

https://simonwillison.net/2025/Mar/2/hallucinations-in-code/

Comments

designatednerd.mastodon.social.ap.brid.gy•1 day ago

@mergesort @simon one key thing this doesn’t address is that these hallucinated APIs make it hard for people new to or with priors against AI coding to trust the model to the extent that they want to put this kind of effort in to make it better.

mergesort.macaw.social.ap.brid.gy•1 day ago

@designatednerd Maybe in not those words exactly, but I think it's reasonably well covered in the “Manually testing code is essential” section.

designatednerd.mastodon.social.ap.brid.gy•1 day ago

@mergesort I mean that’s true of any code you get from not you- thinking especially here of stack overflow.

mergesort.macaw.social.ap.brid.gy•1 day ago

@designatednerd I agree, and have come across plenty of APIs that didn’t work from StackOverflow answers.

designatednerd.mastodon.social.ap.brid.gy•1 day ago

@mergesort I have come across many that didn’t work the way they were described, but I don’t think I’ve ever seen one made up out of whole cloth.

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply