Always remember that using a response schema for an LLM is not the same as using one for your API. Sounds easy, but happens to everyone. Here's OpenAI breaking the CoT reasoning of an LLM judge. - ThreadSky

dylancastillo.co • 56 days ago

Always remember that using a response schema for an LLM is not the same as using one for your API.

Sounds easy, but happens to everyone.

Here's OpenAI breaking the CoT reasoning of an LLM judge.