论文标题
嵌入式数据库中模式进化研究的可复制性和可重复性
Replicability and Reproducibility of a Schema Evolution Study in Embedded Databases
论文作者
论文摘要
确定独立伪造或重复已发表结果的可行性对于科学过程至关重要,并且在许多学科中常规执行复制或繁殖实验。不幸的是,此类研究仅在数据库研究中几乎无法获得,很少有专门评估已发表的结果的论文。在本文中,我们进行了一项有关复制和再现嵌入式数据库中模式进化的研究的案例研究。我们获得了研究的四个数据库应用程序中的一个,并在另外两种情况下结束了结果。通过报告结果,努力和遇到的障碍,我们希望对确保可重复性所需的实质性努力进行感谢。通过讨论可复制工作所需的细节细节,我们认为如此重要但经常被忽略的科学工作组成部分应该在评估未来的研究时获得更多信用。
Ascertaining the feasibility of independent falsification or repetition of published results is vital to the scientific process, and replication or reproduction experiments are routinely performed in many disciplines. Unfortunately, such studies are only scarcely available in database research, with few papers dedicated to re-evaluating published results. In this paper, we conduct a case study on replicating and reproducing a study on schema evolution in embedded databases. We obtain exact results for one out of four database applications studied, and come close in two further cases. By reporting results, efforts, and obstacles encountered, we hope to increase appreciation for the substantial efforts required to ensure reproducibility. By discussing minutiae details required for reproducible work, we argue that such important, but often ignored components of scientific work should receive more credit in the evaluation of future research.