论文标题

软件工程用户研究招聘多产:经验报告

Software Engineering User Study Recruitment on Prolific: An Experience Report

论文作者

Reid, Brittany, Wagner, Markus, d'Amorim, Marcelo, Treude, Christoph

论文摘要

在线参与者招聘平台(例如多产)在研究中一直在越来越受欢迎,因为它们使研究人员能够轻松访问大量参与者。但是,参与者的质量可能是一个问题。参与者可能会提供错误的信息,以获取更多的研究,从而增加了不良的噪音。本文详细介绍了我们从多产的参与者招募参与者的经验,以进行用户研究,要求Node.js中的编程技能,以帮助其他研究人员进行类似的研究。我们探索了一种使用预筛选验证,注意检查和一系列编程知识问题招募程序员参与者的方法。我们收到了680个回复,并确定55个符合我们的用户研究的标准。我们最终通过与10名参与者的视频通话进行了用户学习会议。我们通过针对研究人员提出了一系列建议,总结了本文。

Online participant recruitment platforms such as Prolific have been gaining popularity in research, as they enable researchers to easily access large pools of participants. However, participant quality can be an issue; participants may give incorrect information to gain access to more studies, adding unwanted noise to results. This paper details our experience recruiting participants from Prolific for a user study requiring programming skills in Node.js, with the aim of helping other researchers conduct similar studies. We explore a method of recruiting programmer participants using prescreening validation, attention checks and a series of programming knowledge questions. We received 680 responses, and determined that 55 met the criteria to be invited to our user study. We ultimately conducted user study sessions via video calls with 10 participants. We conclude this paper with a series of recommendations for researchers.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源