Classification Accuracy of Neuroimaging Biomarkers in Attention-Deficit/Hyperactivity Disorder: Effects of Sample Size and Circular Analysis.
Classification Accuracy of Neuroimaging Biomarkers in Attention-Deficit/Hyperactivity Disorder: Effects of Sample Size and Circular Analysis.
复制标题
DOI:
10.1016/j.bpsc.2018.06.003
复制
发表时间:
2019-03
期刊:
影响因子:
--
通讯作者:
Lenartowicz A
中科院分区:
文献类型:
--
作者:
Pulini AA;Kerr WT;Loo SK;Lenartowicz A
Motivated by an inconsistency between reports of high diagnosis-classification accuracies and known heterogeneity in Attention Deficit Hyperactivity Disorder (ADHD), this study assessed classification accuracy in studies of ADHD as a function of methodological factors that can bias results. We hypothesized that high classification results in ADHD diagnosis are inflated by methodological factors. We reviewed 69 studies (of 95 studies identified) that used neuroimaging features to predict ADHD diagnosis. Based on reported methods, we assessed the prevalence of circular analysis, which inflates classification accuracy, and evaluated the relationship between sample size and accuracy to test if small-sample models tend to report higher classification accuracy, also an indicator of bias. Circular analysis was detected in 15.9% of ADHD classification studies, lack of independent test set was noted in 13% and insufficient methodological detail to establish its presence in another 11.6%. Accuracy of classification ranged from 60% to 80% in the 59.4% of reviewed studies that met criteria for independence of feature selection, model construction and test datasets. Moreover, there was a negative relationship between accuracy and sample size, implying additional bias contributing to reported accuracies at lower sample sizes. High classification accuracies in neuroimaging studies of ADHD appear to be inflated by circular analysis and small sample size. Accuracies on independent datasets were consistent with known heterogeneity of the disorder. Steps to resolve these issues, and a shift towards accounting for sample heterogeneity and prediction of future outcomes, will be crucial in future classification studies in ADHD.
登录
查看更多内容
影响因子:
3
作者:
Combrisson, Etienne;Jerbi, Karim
通讯作者:
Jerbi, Karim
影响因子:
5.7
作者:
Arbabshirani MR;Plis S;Sui J;Calhoun VD
通讯作者:
Calhoun VD
影响因子:
3
作者:
Chang CW;Ho CC;Chen JH
通讯作者:
Chen JH
影响因子:
3
作者:
Arns, Martijn;Conners, C. Keith;Kraemer, Helena C.
通讯作者:
Kraemer, Helena C.
DOI:
10.1016/j.compmedimag.2016.04.004
发表时间:
2016-09-01
影响因子:
5.7
作者:
Du, Junqiang;Wang, Lipeng;Zhang, Daoqiang
通讯作者:
Zhang, Daoqiang