#ICHPS2025 keynote @sherrirose.bsky.social - LLMs / AI models are not ready for diagnostic work; be immediately skeptical about claims, check paper’s methodology, data sources - not all of them even use the actual patient data.
Comments
Log in with your Bluesky account to leave a comment
#ICHPS2025 @sherrirose.bsky.social of concerns are: environmental impact (1+ orders of magnitude vs google search per query); labor exploitation (mturk for labeling); unlicensed use of copyrighted and private materials as training data (which can be recovered with smart prompts)
#ICHPS2025 @sherrirose.bsky.social distinguish world as it should be vs world as it is (societal bias) - world according to data (nonrepresentative sampling, measurement errors)
#ICHPS2025 @sherrirose.bsky.social need for minimum reqs - high volume of low quality ML/AI - unclear description of tools, sources used, metrics. We would benefit from having standards developed and adopted by community, followed by buy-in from journal editors https://doi.org/10.1136/bmj.q324
#ICHPS2025 @sherrirose.bsky.social attenuate claims regarding readiness for translation into practice. Your regional pilot study is not a basis for worldwide solution.
Comments