The interpretation of statistical power after the data have been gathered

The interpretation of statistical power after the data have been gathered
复制标题

DOI:
10.1007/s12144-018-0018-1
复制
发表时间:
2020-06-01
期刊:
影响因子:
2.8
通讯作者:
Abar, Beau
Abar, Beau
中科院分区:
心理学4区
文献类型:
--
作者:
Dziak, John Joseph;Dierker, Lisa C.;Abar, Beau

文献摘要

被引文献

相似文献

事后功效估计(在执行假设检验后计算假设检验的功效)有时会被评审员要求,以促进更严格的设计。然而,不应要求或报告这些数据,因为这些数据已被证明在逻辑上是无效的,实际上是误导性的。我们回顾了与事后功率相关的问题,特别是这样一个事实,即由此产生的计算功率是p值的单调函数,因此不包含额外的有用信息。然后,我们讨论了一些情况下,似乎在第一次呼吁事后功率分析,如试图决定一个空的调查结果的实际影响,或试图确定一个二级数据分析的样本量是否足以进行拟议的分析,并考虑可能的方法来实现这些目标。我们在可以提出明确建议的情况下提出了实践建议,并指出了需要进一步方法研究和讨论的其他情况。
Post-hoc power estimates (power calculated for hypothesis tests after performing them) are sometimes requested by reviewers in an attempt to promote more rigorous designs. However, they should never be requested or reported because they have been shown to be logically invalid and practically misleading. We review the problems associated with post-hoc power, particularly the fact that the resulting calculated power is a monotone function of the p value and therefore contains no additional helpful information. We then discuss some situations that seem at first to call for post-hoc power analysis, such as attempts to decide on the practical implications of a null finding, or attempts to determine whether the sample size of a secondary data analysis is adequate for a proposed analysis, and consider possible approaches to achieving these goals. We make recommendations for practice in situations in which clear recommendations can be made, and point out other situations where further methodological research and discussion are required.