Request: Are there examples of replications or studies examining whether results change when tested with a larger or different sample of stimuli? - ThreadSky

About ThreadSky

andresm.bsky.social • 119 days ago

Request: Are there examples of replications or studies examining whether results change when tested with a larger or different sample of stimuli?

Comments

chengyaosun.bsky.social•119 days ago

Maybe this can be relevant? Part of the commentary focuses on testing the effect with a few different stimuli, and the effect changed: https://www.pnas.org/doi/full/10.1073/pnas.1810986115

mattmakel.bsky.social•119 days ago

Not a direct specific answer, but I bet this will have your answer: https://forrt.org/reversals/

mikedekay.bsky.social•39 days ago

You might like the metastudies approach, with stimuli and other aspects of the design varied to learn about generalizability and boundary conditions: https://journals.sagepub.com/doi/abs/10.1177/17456916221079611

We also have follow-ups for framing effects with extreme probabilities, somewhat risky options. See PsyArXiv.

andresm.bsky.social•39 days ago

Excellent, thank you!

mikedekay.bsky.social•39 days ago

BTW, we're running another one right now, using four scenarios where we found a significant effect in recent studies (in a particular condition) and four scenarios from earlier studies in which the authors found a nonsignificant effect in the same condition. The data are trickling in.

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply