Character  &  Context

Recruiting Analysts and Co-Authors for a Crowdsourcing Project

Image of a male and female scientist presenting a beaker and molecular structure
By Emily Robinson
What happens when multiple independent analysts test the same hypothesis on the same dataset? Do they come up with the same results, or are the results heavily contingent on the specific analytic strategy chosen? If you’re interested in being a part of finding out, you can sign up here to be a data analyst and co-author on our collaborative crowdsourcing project.
In the first crowdsourcing data analysis project, 29 teams of analysts examined whether soccer referees give more red cards to dark skin toned than light-skin toned players (Silberzahn et al., in preparation; see project page on the Open Science Framework at The outcome was striking: although 62% of teams obtained a significant effect in the expected direction, estimated effect sizes ranged from moderately large to practically nil. 
Following the success of this first project, Brian Nosek, Eric Luis Uhlmann, Amy Sommer, Kaisa Snellman, David Robinson, Raphael Silberzahn, and I have launched a second crowdsourcing data analysis project. For this second project, we have collected the scientific dialogue from to analyze how scientist gender and status affect intellectual conversations. This project adds several new key features to the first crowdsourcing analytics project, in particular having analysts operationalize key variables (e.g., dominant language) on their own and giving analysts the opportunity to propose and vote on their own hypothesis to be tested by the group. 
The full project description is here. All analysts who complete the steps listed in the requirements will receive an author credit on the final paper. We would appreciate a variety of perspectives represented in the group, such as social psychologists and personality psychologists. Also, please feel free to let others know about the opportunity; anyone with the relevant data analysis skills is welcome to take part.
Emily Robinson is a PhD student in Organizational Behavior at INSEAD whose research interests focus on gender, science, and leadership. 

About our Blog

Character & Context is the blog of the Society for Personality and Social Psychology (SPSP). With more than 7,500 members, SPSP is the largest organization of social psychologists and personality psychologists in the world.   

Learn More ›

Questions ›

Writing Resources ›

Contribute to the Blog ›

Get Email Updates from the Blog