Some of the responses to this are like "you're not supposed to use Chatgpt for that," as if Chatgpt doesn't market itself as "the possibilities for this product are endless."
There's a massive problem with STEM reporting in general giving people false ideas about what science and tech can do. But with LLMs the marketing is insane. They are, at best, an academic curiosity being marketed as synthetic life.
💯They talk about a "jagged capabilities frontier"; some things they are extremely good at, lots of things they're terrible at. Coding? Excellent. Being a database of citations? Very bad
The learning curve (right now) is understanding the "jagged frontier) and where you can use it to supplement work
there’s nothing inherently wrong IMO with these chatbots being unable to provide factual information—but they should respond to such queries with “I am unable to provide that information” not by emitting plausible-looking nonsense
Comments
The learning curve (right now) is understanding the "jagged frontier) and where you can use it to supplement work
I'm sorry I don't mean to be insulting but this is an extremely naive take
He tried to take a shortcut and got mad at the tool. 🤷♂️ He should have been mad at himself
*that* is the problem