🤖 Recent Hashtag#BMJ Study Claims "Cognitive Decline" in AI Models - Let's Examine This Critically #AIinMedicine #ResearchQuality - ThreadSky

About ThreadSky

stephanellmann.bsky.social • 71 days ago

🤖 Recent Hashtag#BMJ Study Claims "Cognitive Decline" in AI Models - Let's Examine This Critically #AIinMedicine #ResearchQuality
https://www.bmj.com/content/387/bmj-2024-081948

Comments

stephanellmann.bsky.social•71 days ago

𝐒𝐭𝐮𝐝𝐲 𝐎𝐯𝐞𝐫𝐯𝐢𝐞𝐰:

stephanellmann.bsky.social•71 days ago

The authors administered the Montreal Cognitive Assessment (MoCA) to leading AI models (ChatGPT-4, Claude, Gemini), reporting that:

stephanellmann.bsky.social•71 days ago

🔹Only ChatGPT-4o achieved a "normal" cognitive score (26/30)🔹All models showed difficulties with visuospatial tasks🔹"Older" models performed worse than newer versions

stephanellmann.bsky.social•71 days ago

⁉️Authors suggest AI shows "cognitive aging" similar to humans⁉️

stephanellmann.bsky.social•71 days ago

𝐂𝐫𝐢𝐭𝐢𝐜𝐚𝐥 𝐈𝐬𝐬𝐮𝐞𝐬: 🧩 Fundamentally flawed premise: Applying human cognitive tests to AI systems lacks scientific validity 📊 The "aging" comparison misrepresents how AI models evolve.

stephanellmann.bsky.social•71 days ago

Newer versions are complete replacements, not aged iterations

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply