Archiving Information on the Quality of Survey Measurement

归档有关调查测量质量的信息

• 批准号: 1331454
• 负责人: Duane Alwin
• 金额: $ 27万
• 依托单位: Pennsylvania State Univ University Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-08-15 至 2016-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1331454&HistoricalAwards=false
• 关键词: Archiving; Information; Quality; Survey; Measurement

SES-1331454Duane AlwinPennsylvania State University, University Park This research focuses on the reliability of measurement in social surveys. There has been much written about the sources of measurement errors in surveys and best practices in developing high quality survey instruments, that is, good questionnaires. The overarching goal of the project is to establish a factual basis for conjectures that exist in the survey methods literature concerning what are the qualities of good survey questions. The project will build a publicly accessible data base of information for roughly 900 questions representative of typical questions used in social science surveys. The data base will contain estimates of question-specific reliabilities, along with detailed coding of attributes of the questions (e.g. content, response formats, and question length), which can be used to evaluate the optimal properties of survey questions with respect to levels of measurement error. Through an analysis of the reliability information and the attributes of survey questions from several large-scale panel studies, practical suggestions will be made about the attributes of survey questions that will improve the quality of survey data.This project builds on prior NSF funding, which relied on six nationally (or regionally) representative panel surveys of the American population, all involving probability samples -three National Election panels, the American's Changing Lives panel study, and the Study of American (Detroit Area) Family panel study -which produced question-specific reliability estimates for more than 450 questions. The present study has three major objectives, as follows: (1) extending an existing data base on the reliability of survey measures, (2) replicating prior findings using question-specific reliability estimates for an additional 400 survey questions or more from two new studies (using new analyses of the Health and Retirement Study and General Social Survey panel studies), and (3) developing a long-range plan for a publicly available archive of information on the reliability of survey measurement.Broader ImpactThis research will significantly increase the social science research infrastructure by providing a publicly available data base on reliability estimates for a representative pool of survey questions. Given that survey measurement is a key ingredient in the majority of social science research, the broader impact of the proposed research lies in its contribution to the uses of virtually all types of survey data, which can be evaluated in terms of the results of this study. The research will add to our current knowledge by making the reliability estimates obtained in the prior NSF-supported research, along with the extension proposed here, available to the public in a manner that allows users to search, filter or query the data base in investigating the question reliability of types of survey questions of interest. Thus, the long-range goal of the proposed project to create a public archive of the levels of reliability for the typical kind information gathering approaches used in surveys can have an impact on the development of survey questions for new surveys, as well as increase our understanding of the quality of existing surveys.

SES-1331454 Duane Alwin宾夕法尼亚州立大学，大学公园本研究的重点是社会调查中测量的可靠性。关于调查中计量误差的来源以及制定高质量调查工具（即良好的问卷）的最佳做法，已有很多文章。该项目的总体目标是为调查方法文献中存在的关于良好调查问题的质量的猜测建立事实基础。该项目将为社会科学调查中使用的大约900个代表性问题建立一个可公开访问的信息数据库。数据库将包含对特定问题可靠性的估计，沿着问题属性的详细编码（例如内容、答复格式和问题长度），可用于评估调查问题在测量误差水平方面的最佳属性。通过对几个大规模小组研究的可靠性信息和调查问题属性的分析，将对调查问题的属性提出实用建议，以提高调查数据的质量。（或区域）对美国人口的代表性小组调查，所有涉及概率样本-三个全国选举小组，美国人改变生活小组研究和美国（底特律地区）家庭小组研究的研究-为450多个问题提供了特定问题的可靠性估计。本研究报告有以下三个主要目标：（1）扩展现有的调查措施可靠性数据库，（2）利用两项新研究中的400个或更多调查问题的具体问题可靠性估计，复制先前的调查结果（使用健康与退休研究和综合社会调查小组研究的新分析），（3）建立长期的广泛的影响这项研究将大大增加社会科学研究的基础设施，通过提供一个公开的数据库的可靠性估计，为一个有代表性的池，调查问题。鉴于调查测量是大多数社会科学研究的一个关键组成部分，拟议研究的更广泛影响在于它对几乎所有类型的调查数据的使用做出了贡献，这些数据可以根据本研究的结果进行评估。这项研究将增加我们目前的知识，使可靠性估计在以前的NSF支持的研究，沿着与扩展这里提出的，提供给公众的方式，允许用户搜索，过滤或查询数据库中调查的问题的可靠性类型的调查问题的兴趣。因此，拟议项目的长期目标是建立一个关于调查中使用的典型信息收集方法的可靠性水平的公共档案，这可以对新调查的调查问题的制定产生影响，并增加我们对现有调查质量的了解。