论文标题
用怀疑的p值评估可复制性:I型错误控制和样本量规划
Assessing replicability with the sceptical p-value: Type-I error control and sample size planning
论文作者
论文摘要
我们基于最近提出的重复成功定量度量的统计框架可复制性,即怀疑的$ p $值。提出了重新校准,以获得确切的总体I型误差控制,如果研究中的效果为无效,并且对部分和条件I型错误率的其他界限为无效,这代表了只有一项研究的情况。该方法避免了两次试验规则的重要性的双重二分法化,并且具有更大的项目能力,可以检测到两种研究的现有影响。它也可以用于电源计算,并且需要比两次试验规则更小的复制样本量,以使其令人信服的原始研究。我们说明了在实验经济学复制项目的数据应用程序中提出的方法的性能。
We study a statistical framework for replicability based on a recently proposed quantitative measure of replication success, the sceptical $p$-value. A recalibration is proposed to obtain exact overall Type-I error control if the effect is null in both studies and additional bounds on the partial and conditional Type-I error rate, which represent the case where only one study has a null effect. The approach avoids the double dichotomization for significance of the two-trials rule and has larger project power to detect existing effects over both studies in combination. It can also be used for power calculations and requires a smaller replication sample size than the two-trials rule for already convincing original studies. We illustrate the performance of the proposed methodology in an application to data from the Experimental Economics Replication Project.