Survey experiments are ubiquitous in political science. But I have only found two articles assessing their external validity (Barabas and Jerit (2010) and Hainmueller et al (2015)). Am I missing some key literature here? [polisky] - ThreadSky

joenoonan.se • 498 days ago

Survey experiments are ubiquitous in political science. But I have only found two articles assessing their external validity (Barabas and Jerit (2010) and Hainmueller et al (2015)). Am I missing some key literature here?

[polisky]

Comments

miguelpereira.bsky.social•498 days ago

I would add Incerti's 2020 APSR here.

rmkubinec.bsky.social•497 days ago

As in by running a field experiment after the survey experiment?

benfifield.bsky.social•498 days ago

A few more:

Coppock 2019, PSRM (https://alexandercoppock.com/coppock_2019a.html )
Coppock, Leeper, Mullinix 2018, PNAS (https://alexandercoppock.com/coppock_leeper_mullinix_2018.html )

ihaal.bsky.social•498 days ago

Relatedly, we discuss external validity in our JEL on information provision experiments https://www.aeaweb.org/articles?id=10.1257/jel.20211658

dhidalgo.bsky.social•498 days ago

I'd look at Incerti (2020): https://doi.org/10.1017/S000305542000012X

Builds partly on:
Boas, Hidalgo, and Melo (2018):
https://onlinelibrary.wiley.com/doi/abs/10.1111/ajps.12413

joenoonan.se•498 days ago

Links for easy access:

Hainmueller et al (2015): https://www.pnas.org/doi/10.1073/pnas.1416587112

Barabas and Jerit (2010):
https://www.cambridge.org/core/journals/american-political-science-review/article/abs/are-survey-experiments-externally-valid/7233B1EF4DD36030A0BC19380AEBCDFA

cbarrie.bsky.social•498 days ago

Egami and Hartman (2022) at a higher level: https://www.cambridge.org/core/journals/american-political-science-review/article/elements-of-external-validity-framework-design-and-analysis/2D0914404C84B3F169732FF1D5E39420

joenoonan.se•498 days ago

Looks great thanks!

arielzellman.bsky.social•498 days ago

Another two for you:
Levay Freese Druckman 2016 https://doi.org/10.1177/2158244016636433
Mullinix Leeper Druckman 2015 https://www.cambridge.org/core/journals/journal-of-experimental-political-science/article/abs/generalizability-of-survey-experiments/72D4E3DB90569AD7F2D469E9DF3A94CB?utm_campaign=shareaholic&utm_medium=copy_link&utm_source=bookmark

donmoyn.bsky.social•498 days ago

Mummolo and Peterson, showing demand effects do not seem to be a big deal https://www.cambridge.org/core/journals/american-political-science-review/article/abs/demand-effects-in-survey-experiments-an-empirical-assessment/043386DC63A69098E859414EF9932EBC

nstenhouse.bsky.social•498 days ago

Messages that increased climate concern in survey experiment reduced political action in field experiment https://link.springer.com/article/10.1007/s10584-017-1952-x

gabelenz.bsky.social•497 days ago

The best survey experiments take advantage of obvious external validity biases. They study effects where the survey context should make the effects difficult to find. The worst survey experiments study do the opposite.

chagaiweiss.bsky.social•498 days ago

Might be of interest: https://preprints.apsanet.org/engage/apsa/article-details/6467f4bcfb40f6b3eedcabbb

profdansmith.bsky.social•498 days ago

Not really intended as a test of external validity, but Horiuchi et al. (2020) compare voter preferences for different candidate attributes across electoral systems in a conjoint experiment to the actual prevalence of those attributes among elected politicians. https://www.cambridge.org/core/journals/political-science-research-and-methods/article/abs/identifying-voter-preferences-for-politicians-personal-attributes-a-conjoint-experiment-in-japan/95ADB2B43C5289ECFE6898B7FE776CFE

hjghassell.bsky.social•497 days ago

Here are two more. One with consistent findings and one without:
https://www.science.org/doi/10.1126/sciadv.aay9344

https://link.springer.com/article/10.1007/s11109-022-09836-9

Posting Rules

Be respectful to others
No spam or self-promotion
Stay on topic
Follow Bluesky's terms of service

Comments

Posting Rules

Reply