Psychometrics and the Neuroscience of Individual Differences: Internal Consistency Limits Between-Subjects Effects

Psychometrics and the Neuroscience of Individual Differences: Internal Consistency Limits Between-Subjects Effects
复制标题

DOI:
10.1037/abn0000274
复制
发表时间:
2017-08-01
影响因子:
4.6
通讯作者:
Kotov, Roman
Kotov, Roman
中科院分区:
心理学1区
文献类型:
--
作者:
Hajcak, Greg;Meyer, Alexandria;Kotov, Roman

文献摘要

被引文献

相似文献

在临床神经科学文献中,被试之间的神经活动差异被假定为反映可靠的措施,即使神经措施的心理测量特性几乎从未报道过。本文重点关注评估和报告内部一致性可靠性的至关重要性--构成神经“评分”的“项目”的同质性。“我们展示了神经测量的内部一致性的可变性如何限制受试者之间的差异(即,个体差异)的影响。为此,我们利用与错误相关的大脑活动(即,错误相关的消极或ERN),以证明神经测量的心理测量分析的选项;我们检查了内部一致性、组间效应大小和组间辨别力(即,ROC分析)-全部作为增加项目的函数(即,试验次数)。总体而言,在个体差异研究中,内部一致性应用于指导实验设计和神经测量方法的选择。神经措施的内部一致性是必要的解释结果和指导临床神经科学的进展,并应定期报告在所有的个体差异study.General Scientific SummaryLimited的进步,从临床神经科学可能源于失败的领域,以考虑基本的测量性能的神经措施。本文强调了内部一致性对组间效应量的影响,并建议报告和使用内部一致性来解释和指导使用神经科学测量的个体差异研究。
In the clinical neuroscience literature, between-subjects differences in neural activity are presumed to reflect reliable measures-even though the psychometric properties of neural measures are almost never reported. The current article focuses on the critical importance of assessing and reporting internal consistency reliability-the homogeneity of "items" that comprise a neural "score." We demonstrate how variability in the internal consistency of neural measures limits between-subjects (i.e., individual differences) effects. To this end, we utilize error-related brain activity (i.e., the error-related negativity or ERN) in both healthy and generalized anxiety disorder (GAD) participants to demonstrate options for psychometric analyses of neural measures; we examine between-groups differences in internal consistency, between-groups effect sizes, and between-groups discriminability (i.e., ROC analyses)-all as a function of increasing items (i.e., number of trials). Overall, internal consistency should be used to inform experimental design and the choice of neural measures in individual differences research. The internal consistency of neural measures is necessary for interpreting results and guiding progress in clinical neuroscience-and should be routinely reported in all individual differences studies.General Scientific SummaryLimited advances from clinical neuroscience may stem from a failure in the field to consider basic measurement properties of neural measures. This article highlights the impact of internal consistency on between-groups effect sizes, and suggests reporting and using internal consistency to interpret and guide individual differences research that uses neuroscience measures.