论文标题
开源软件,用于高效且透明的评论
Open Source Software for Efficient and Transparent Reviews
论文作者
论文摘要
为了帮助研究人员尽可能高效,透明地进行系统的审查或荟萃分析,我们设计了一种工具(Asreview)来加速筛选标题和摘要的步骤。对于许多任务(包括但不限于系统评价和荟萃分析),需要系统地检查科学文献。目前,学者和从业人员手工筛选了数千个研究,以确定在审查或荟萃分析中包括哪些研究。由于数据极为不平衡,这是错误且效率低下的错误:只有一小部分筛选研究是相关的。系统审查的未来将与机器学习算法进行互动,以应对可用文本的巨大增加。因此,我们开发了一种应用主动学习的开源机器学习辅助管道:Asreview。我们通过模拟研究证明,Asreview在提供高质量的同时,与手动审查相比,Asreview可以产生更有效的审查。此外,我们描述了免费和开源研究软件的选项,并介绍了用户体验测试的结果。我们邀请社区为开源项目(例如我们自己的开源项目)做出贡献,这些项目可为当前实践提供可衡量且可重复的改进。
To help researchers conduct a systematic review or meta-analysis as efficiently and transparently as possible, we designed a tool (ASReview) to accelerate the step of screening titles and abstracts. For many tasks - including but not limited to systematic reviews and meta-analyses - the scientific literature needs to be checked systematically. Currently, scholars and practitioners screen thousands of studies by hand to determine which studies to include in their review or meta-analysis. This is error prone and inefficient because of extremely imbalanced data: only a fraction of the screened studies is relevant. The future of systematic reviewing will be an interaction with machine learning algorithms to deal with the enormous increase of available text. We therefore developed an open source machine learning-aided pipeline applying active learning: ASReview. We demonstrate by means of simulation studies that ASReview can yield far more efficient reviewing than manual reviewing, while providing high quality. Furthermore, we describe the options of the free and open source research software and present the results from user experience tests. We invite the community to contribute to open source projects such as our own that provide measurable and reproducible improvements over current practice.