Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting
Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting
复制标题
DOI：
10.1016/j.ijpsycho.2016.09.005
复制
发表时间：
2017-01-01
影响因子：
3
通讯作者：
Miller, Gregory A.
中科院分区：
文献类型：
--
作者：
Clayson, Peter E.;Miller, Gregory A.
如果不考虑与信度和效度、差异性缺陷和统计功效相关的心理测量学问题，可能会破坏研究的结论。在使用事件相关脑电位（ERP）的研究中，许多背景因素（人口抽样，任务，数据记录，分析管道等）会影响ERP评分的可靠性。本审查认为，影响ERP分数的可靠性和下游的影响，可靠性的统计分析的上下文因素。鉴于ERP的上下文依赖性，建议ERP分数的可靠性正式评估的研究，研究的基础上。ERP研究的推荐指南包括：1）报告可接受的可靠性阈值和观察评分的可靠性估计值，2）指定用于估计可靠性的方法，以及3）证明如何选择试验计数最小值。建议内部一致性的可靠性阈值至少为0.70，最好为0.80。该评论还主张使用概化理论来估计分数的可靠性（概化理论的可靠性模拟）作为对经典测试理论可靠性估计的改进，这表明后者不太适合ERP研究。为了方便可靠性估计的计算和报告，提供了一个开源的Matlab程序，即ERP可靠性分析工具箱。(C)2016爱思唯尔B.V.保留所有权利。
Failing to consider psychometric issues related to reliability and validity, differential deficits, and statistical power potentially undermines the conclusions of a study. In research using event-related brain potentials (ERPs), numerous contextual factors (population sampled, task, data recording, analysis pipeline, etc.) can impact the reliability of ERP scores. The present review considers the contextual factors that influence ERP score reliability and the downstream effects that reliability has on statistical analyses. Given the context-dependent nature of ERPs, it is recommended that ERP score reliability be formally assessed on a study-by-study basis. Recommended guidelines for ERP studies include 1) reporting the threshold of acceptable reliability and reliability estimates for observed scores, 2) specifying the approach used to estimate reliability, and 3) justifying how trial-count minima were chosen. A reliability threshold for internal consistency of at least 0.70 is recommended, and a threshold of 0.80 is preferred. The review also advocates the use of generalizability theory for estimating score dependability (the generalizability theory analog to reliability) as an improvement on classical test theory reliability estimates, suggesting that the latter is less well suited to ERP research. To facilitate the calculation and reporting of dependability estimates, an open-source Matlab program, the ERP Reliability Analysis Toolbox, is presented. (C) 2016 Elsevier B.V. All rights reserved.