For folks using #Prolific, is there an option to report participants providing low-quality data? I prefer not to reject submissions. I wish there was a way to log low quality submissions and if enough people reported same participant they'd get booted from the platform - ThreadSky

rafmbatista.bsky.social • 48 days ago

For folks using #Prolific, is there an option to report participants providing low-quality data?

I prefer not to reject submissions. I wish there was a way to log low quality submissions and if enough people reported same participant they'd get booted from the platform

Comments

blasimon.bsky.social•48 days ago

I only use Cloudresearch Connect, where there’s a “universal block list.” I’m assuming they monitor stats of users being added across such lists in addition to rejections. Is there a similar block list on prolific?

rafmbatista.bsky.social•47 days ago

Oh forgot CloudResearch has that! That's great

Don't think Prolific does. Now they allow you to create it for your own account but haven't seen a universal one

richard-mills.bsky.social•48 days ago

I might be wrong, but rejections are actually a good way to weed out 'bad' Prolific users. After a certain number of rejections, they no longer get asked to participate in research. A good incentive in my view to provide high quality responses.

rafmbatista.bsky.social•48 days ago

Maybe. But idk what's going on in people's lives and believe that some folks really are spending time on here (even if distracted/multitasking/etc)

If it says they took 20 minutes, I don't have the heart to reject :/

richard-mills.bsky.social•48 days ago

Yeah, I understand. You could always 'approve' and send them a private message on the platform to pay more attention in future studies (or something along these lines). Attention-checks are also useful for this exact reason (provides a legitimate reason to reject).

brettbuttliere.bsky.social•41 days ago

isnt using sites like prolific and mturk considered no longer good practice because it is basically exploitative and etc?

rafmbatista.bsky.social•39 days ago

Oh, say more?

What do you mean by exploitative?

For whom is it not good practice?

brettbuttliere.bsky.social•39 days ago

it is for the people who cannot or are too lazy to get participants in a normal way. how much do you pay per hour? it used to be like 5$ on average which was below the minimum wage at the time.

my impression is that since about 2015 its been viewed as less than ideal

Comments

Posting Rules

Reply