A general critical appraisal tool: An evaluation of construct validity
A general critical appraisal tool: An evaluation of construct validity
复制标题
DOI：
10.1016/j.ijnurstu.2011.06.004
复制
发表时间：
2011-12-01
影响因子：
8.1
通讯作者：
Sheppard, Lorraine
中科院分区：
文献类型：
--
作者：
Crowe, Michael;Sheppard, Lorraine
工作背景：许多关键评估工具（CAT）的存在，有很少或根本没有信息的CAT的发展，有效性评估，或测试的可靠性。建议的CAT是在其他CAT、一般研究方法理论和报告指南的基础上开发的，但需要进一步研究以确定其有效性。目的：在进行信度测试之前，建立一个评分系统并评估建议的关键评估工具的结构效度。从这项探索性研究中获得的数据沿着与拟议的CAT设计的信息相结合，使用教育和心理测试标准评估结构效度，该标准包括五个证据类型：测试内容、反应过程、内部结构、与其他变量的关系以及测试结果。为了获得内部结构和与其他变量的关系的数据，对拟议的CAT进行了分析，对五个替代CAT。一个随机样本的10篇论文，从6个不同的研究设计的范围内的健康相关research. Results的，总样本量为60 papers.Results：在所有的研究设计，建议CAT有显着的（p < 0.05，双尾）弱到中度正相关（肯德尔的tau 0.33-0.55）与替代CAT，除了在序言类别。在准实验（tau 0.70-1.00）、描述性/探索性/观察性（tau 0.72-1.00）、定性（tau 0.74-0.81）和系统综述（tau 0.62-0.82）设计中存在显著的中度至强正相关性，在真正的实验（tau. 0.68-0.70）设计。有没有显着的相关性，在单系统的研究designs.Conclusions：根据所获得的结果，理论上，建议CAT的设计，和建议CAT的目标有足够的证据表明，从分数从建议CAT的推断应该是合理的。(C)2011爱思唯尔有限公司保留所有权利。
Background: Many critical appraisal tools (CATs) exist for which there is little or no information on development of the CAT, evaluation of validity, or testing reliability. The proposed CAT was developed based on a number of other CATs, general research methods theory, and reporting guidelines but requires further study to determine its effectiveness.Objectives: To establish a scoring system and to evaluate the construct validity of the proposed critical appraisal tool before undertaking reliability testing.Methods: Data obtained from this exploratory study along with information on the design of the proposed CAT were combined to evaluate construct validity using the Standards for educational and psychological testing which consist of five types of evidence: test content, response process, internal structure, relations to other variables, and consequences of testing. To obtain data for internal structure and relations to other variables, the proposed CAT was analysed against five alternative CATs. A random sample of 10 papers from six different research designs across the range of health related research were selected, giving a total sample size of 60 papers.Results: In all research designs, the proposed CAT had significant (p < 0.05, two-tailed) weak to moderate positive correlations (Kendall's tau 0.33-0.55) with the alternative CATs, except in the Preamble category. There were significant moderate to strong positive correlations in the quasi-experimental (tau 0.70-1.00), descriptive/exploratory/observational (tau 0.72-1.00), qualitative (tau 0.74-0.81), and systematic review (tau 0.62-0.82) designs and to a lesser extent in the true experimental (tau. 0.68-0.70) design. There were no significant correlations in the single system research designs.Conclusions: Based on the results obtained, the theory on which the proposed CAT was designed, and the objective of the proposed CAT there was enough evidence to show that inferences made from scores obtained from the proposed CAT should be sound. (C) 2011 Elsevier Ltd. All rights reserved.