Profile avatar
psforscher.bsky.social
Director of the CREME developmental meta-research team at Busara, a non-profit that does behavioral science in service of poverty alleviation. https://patrickforscher.com/
328 posts 1,448 followers 267 following
Prolific Poster
Conversation Starter

Causal inference iceberg! What's missing?

In easily the nerdiest thing I ever did (besides get a PhD tbf) since 2023 I have been maintaining a fanlore hobby site for my 40k guys. I am now sharing it with people! I've commissioned some art and wrote some short stories (often my morning commute!) so, yeah, enjoy! sherdenpact.neocities.org

When I investigate survey and item burden, I usually find only tiny effects on participation. In this cool study, there's a much bigger effect: we can see that a mandatory survey (dashed lines) functions as a pretty big barrier. Many participants stop using the app when the survey is required.

i look forward to reading this, but initial scan suggests it’s tinkering with a process that might benefit from more radical upheaval.

Scientific publisher Elsevier made a £1 billion profit last year "driven by volume growth, with article submissions growing very strongly across the portfolio, particularly in pay-to-publish" www.researchprofessionalnews.com/rr-news-worl...

What relevance does the replication crisis have for non-academic research, such as the methods used to evaluate social programs? In a new paper with Ben McNamee and Michael Lenczner, we argue that the answer could be quite a lot Article: onlinelibrary.wiley.com/doi/10.1002/... OA: osf.io/6hevp

Love this new paper that shows how impact evaluation research may be heading towards a replication crisis: "RCT valorization and rhetorical rigor lead to a world where complexity, veracity, and usefulness is sacrificed for a narrow interpretation of “rigor." onlinelibrary.wiley.com/doi/10.1002/...

This paper is coming out at a strange time. On the one hand, a lot of social programming is under assault. On the other, there clearly are credibility issues to address: see, for example, this evidence suggesting fraud at the non-profit, GDRI bsky.app/profile/i4re...

After being alerted about possible misconduct, the I4R are reproducing published papers that use data from a specific NGO (GDRI). This thread releases the first 2 reports and provides more information about the work and responses/statements from authors journals and journals. 🧵

A tracker estimating deaths caused by the partial PEPFAR funding suspension: pepfar.impactcounter.com. Methodology here: pepfar.impactcounter.com/methodology.

What relevance does the replication crisis have for non-academic research, such as the methods used to evaluate social programs? In a new paper with Ben McNamee and Michael Lenczner, we argue that the answer could be quite a lot Article: onlinelibrary.wiley.com/doi/10.1002/... OA: osf.io/6hevp

A starter pack for people interested in behavioral, cognitive and cultural aspects of antimicrobial resistance. Happy to add you if you are active in this area. go.bsky.app/9i8zPz See also www.a-bc.network #AMR #AntibioticResistance #AntibioticStewardship #BehavioralInsights #AMRBehaviorChange

This is such a great magazine - African journalism by African journalists, delivered weekly for free via whatsapp. Subscribe: wa.me/27738056068?...

**d = 1.12** I wonder what kind of stimuli lead to such differences... Seems like an indicator that many detection studies use trivially obvious examples of fake news (?)

All metascience interested: Please contribute to the conceptualization and initial launch of the Metascience Alliance to create weak ties among the many organizations, sectors, fields, and researchers that are advancing metascience. Links below to get involved.

Going to #spsp2025? Curious to see the first release of the results of a big team science test of stereotype threat theory on Black college students involving 2,513 participants? Then you may want to check out the following talk, presented by my co-lead Valerie Taylor on Friday, 3:15pm, 21 February

Which universities have the most retracted articles - and the highest retraction rates? For @nature.com, here's a first-of-its-kind analysis of retractions by institutions. Full details in the story. www.nature.com/articles/d41...

Friends, I have written you a book on forensic metascience. It is free. You can have it. Happy St. Valentine's Day. If you wish to give me a gift back, you can use it to cause trouble - the greatest gift of all. open.substack.com/pub/jamescla...

A historic graphic of corruption. The 11 federal agencies so far targeted for firings or dismantling by Elon Musk have more than 30 ongoing investigations into his companies. (📸 Malika Khurana for NYT)

I found this to be an informative and provocative read - what happened to cognitive science? Authors argue, based on bibliometric and scientometric analysis, that cognitive science as a discipline is basically dead. www.nature.com/articles/s41...

Proposals for formalising evidence evaluation fascinate n disturb me. It's notable that a certain type of study strongly predicts policy success. But the key lesson from recent #philsci that evidence is only strong when you can *combine* different types of it into a robust theory of change.

I have a piece half-done on the entire world of indirect costs. It's too big an endeavor to finish now, in the middle of the night, when this problem *that was always a live grenade with a half-pulled pin* is suddenly a topic du jour. Shit of a thing. Here are some highlights.

This is an insane move for NIH to make when the obvious answer is to review all the F grants this cycle as a single pool.

Curious about how an applied behavioral science organization in the Global South thinks about its impact? Then check Busara's annual report on this topic. It contains my contribution, which argues for qualitative rather than strictly quantitative impact assessments busara.global/our-works/ta...

Curious about how an applied behavioral science organization in the Global South thinks about its impact? Then check Busara's annual report on this topic. It contains my contribution, which argues for qualitative rather than strictly quantitative impact assessments busara.global/our-works/ta...

This Registered Report masterpiece just dropped at BMC Biology, brilliantly led by a great team with the help of 300+ analysts & reviewers Same question, same data: go figure! tl;dr: Substantial heterogeneity among results comes from differences among analytical choices 🔗 doi.org/10.1186/s129...

i'll be blunt, if you are someone who is vocal about the ways that diversity efforts "divide the working class" but silent about the ways that *actual racism and discrimination* divide the working class, then i think you're just an opportunist

Brian Wansink's whole gig getting blown up by him admitting to p-hacking in a smug blog post is just an all time great self-own. Well worth reading about if you don't know the story. www.buzzfeednews.com/article/step...

aaaand now it all makes sense

Going right into my preparation for next semester's "Applied Research Methods as Strategic Tools" in our interdisciplinary professional doctorate. #RD62001 #RD62002 #ProfDoc #Sampling #ReserachMethods

Hey if anyone is considering backing up any datasets for some reason today, the Open Science Framework has free storage up to 5G/private repository, and up to 50G/public repository. (The OSF is run by a 501c3 (Center for Open Science), so if you do this you might also consider making a donation.)