Profile avatar
shahanmemon.bsky.social
Researching {science of science #SciSci, #AI4Science, computational social science, generative #AI, LLMs, agents, alignment, misinformation in science} PhD @ UW. Visiting scholar @ NYU. Alum @ Carnegie Mellon Academic webpage: https://samemon.github.io
547 posts 2,772 followers 1,203 following
Regular Contributor
Active Commenter
Posts 20 Comments 30

Straight to my CV 🤭 I was heavily featured in @sunelehmann.com 's ICSSI dinner talk. ( dx.doi.org/10.2139/ssrn... relates a bit to Sune's talk)

submitted 5 days ago • 0 comments

All new submissions to @nathumbehav.nature.com that are published will be accompanied by referees’ reports and author responses. Let’s go!!!! Anyone (wanna) study(ing) this as a natural experiment? 🙃 #Metascience #SciSci #TransparentScience

submitted 3 days ago • 2 comments

Maybe you missed it, but science died 3 years ago..”Dead science theory”? #SciSci #ScAISci #metasci

submitted 3 days ago • 1 comment

My notes on Anthropic's substantial essay about how they built their multi-agent research system, which has finally talked me around to taking multi-agent LLM prompt engineering seriously simonwillison.net/2025/Jun/14/...

submitted 8 days ago • 4 comments

🚨 70 million US workers are about to face their biggest workplace transmission due to AI agents. But nobody’s asking them what they want. While AI R&D races to automate everything, we took a different approach: auditing what workers want vs. what AI can deliver across the US workforce.🧵

submitted 10 days ago • 1 comment

Should LLMs be used to review papers? AAAI is piloting LLM-generated reviews this year. I wrote a blog post arguing that using LLMs as reviewers can have bad downstream consequences for science by centralizing judgments about what constitutes good research. bryanwilder.github.io/files/llmrev...

submitted 27 days ago • 12 comments

🚨PSA for anyone using GPT in human subjects research🚨 A judge has ruled that OpenAI must retain ChatGPT and API data indefinitely, with few exceptions. This might have implications for your IRB compliance and the security of your participants' data. 1/

submitted 14 days ago • 10 comments

Want to add an LLM chatbot to your Qualtrics surveys? Here's a step-by-step guide showing exactly how to do this with AWS Bedrock joshuakalla.github.io/llm_persuasi...

submitted 16 days ago • 2 comments

The spillover from events like this extends beyond a single paper. When a high-profile study like this is withdrawn, especially one that was widely discussed and covered, it has broader implications. This study had an Altmetric score of over 130. #retractions #SciSci #attention #AI 🧵 1/4

submitted 18 days ago • 1 comment

We are reviewing the current state of scientific publishing, and we want to hear from researchers on their perceptions of publishing in the current context and how it might develop in future. Complete our short survey now:

submitted 18 days ago • 6 comments

The spillover from events like this extends beyond a single paper. When a high-profile study like this is withdrawn, especially one that was widely discussed and covered, it has broader implications. This study had an Altmetric score of over 130. #retractions #SciSci #attention #AI 🧵 1/4

submitted 18 days ago • 1 comment

“Anonymous GitHub” — I just discovered this today. What a great idea!! (Apparently I am the 46,631ˢᵗ to find it.) Provides an anonymized portal to your GitHub respiratory suitable for submission to double-blind review for research conference papers or journal articles. anonymous.4open.science

submitted 19 days ago • 3 comments

The AI-Productivity Paper That Fooled a Nobel. nicolasrasmont.substack.com/p/the-ai-pap... #AIMediatedScience #AI #Retraction #SciSci

submitted 18 days ago • 1 comment

Here's one to watch! Science-integrity project will root out bad medical papers ‘and tell everyone’ group behind @retractionwatch.com is on a roll. @jamesheathers.bsky.social heading the new effort www.nature.com/articles/d41...

submitted 18 days ago • 2 comments

I talked to 15 teachers/professors about how AI and ChatGPT is ruining their lives: www.404media.co/teachers-are...

submitted 20 days ago • 116 comments

The video from this event is now available. youtu.be/mFJrU878Kp4?... I shared some of the work I've been a part of in collaboration with the Washington state's Office of Superintendent of Public Instruction (OSPI) on developing #AI Ethics guidance for K–12 #education. #AIEducation 1/3

submitted 19 days ago • 1 comment

Especially with AI, there is an argument to be made that the diameter of science has reduced (e.g., arxiv.org/abs/2412.07727) and there is a potential drift towards scientific monocultures (www.nature.com/articles/s41...), increasing the period of Kuhn’s normal science, and thereby delaying novelty?

submitted 22 days ago • 1 comment

What happens when scientists leave their original research theme to explore a new field? A new @nature.com paper by @dashunwang.bsky.social et al quantifies this "pivot" and shows that it comes at a cost: work in new fields receives relatively fewer citations 🧪 www.nature.com/articles/s41...

submitted 24 days ago • 1 comment

"The AI industry is saturated in spectacle. The spectacle of AI, more so than the tool of AI, speaks to dreams of generalities, born from abstractions, forced together through the violent reduction of our world to tiny signals." - @eryk.bsky.social mail.cyberneticforests.com/human-noise-...

submitted 28 days ago • 0 comments

Despite clickbaity title this is a great level-headed piece from a real scientist who tried working in AI for science. The key point that AI is a tool not an all encompassing revolution is common sense but the details are interesting and illuminating open.substack.com/pub/understa...

submitted 31 days ago • 1 comment