sorry posted a wrong link on the first go: this is the episode of this american life is an interesting exploration of the topic of how to think about the reasoning capacities of gen ai www.thisamericanlife.org/803/transcript - ThreadSky

sanderwagner.bsky.social • 94 days ago

sorry posted a wrong link on the first go:
this is the episode of this american life is an interesting exploration of the topic of how to think about the reasoning capacities of gen ai
https://www.thisamericanlife.org/803/transcript

Comments

katyahe.bsky.social•71 days ago

I really like AI Snake Oil book on the subject by @randomwalker.bsky.social https://press.princeton.edu/books/hardcover/9780691249131/ai-snake-oil?srsltid=AfmBOorj1DFbpCT285x6lfNb9V22Bp09jDligNFoyuWuX4qZOSqPjAZr
would recommend as a great holiday read too!

sanderwagner.bsky.social•71 days ago

will get that. I am also not summing all of this up in some sort of utopian "this will solve everything" way and think a lot of scepticism is warranted, just trying to keep a tab on the many things that are currently happening.

katyahe.bsky.social•71 days ago

I know! I wish more of coverage of AI to[ics really focused on what it does well vs on what it cannot do really, or does badly...

Hope all is well with you guys, happy holidays!

sanderwagner.bsky.social•71 days ago

tell me about it, i am still working on a project where we used LLMs to assign all the UK Impact Case Studies to topics, and I then led a team doing human judgment reassignment of topics (which is so much work) but we have about 20% of misassignment by the machines for many many reasons...

sanderwagner.bsky.social•71 days ago

we went to the American family for christmas. So we are in Grand Rapids doing midwestern christmas with snow. Its lovely. Many greetings to you as well!

katyahe.bsky.social•71 days ago

sounds amazing! And thank you! We just had a lovely German Christmas!

katyahe.bsky.social•71 days ago

Interesting! Did you publish a discussion/exploration of reasons for machine misalignment? I'd love to read!

sanderwagner.bsky.social•71 days ago

No, its not the central aim of the research, which is to provide a mapping of the societal impact of UK research, but I might, once we are done with that, go into more detail on why the machines often map language proximity between texts in ways that do not perfectly allign with meaning proximity.

Comments

Posting Rules

Reply