Improving Public Health Grey Literature Access for the Public Health Workforce

描述(由申请人提供)：拟议项目的长期目标是为公共卫生(PH)工作人员提供更好的机会，获得高质量的相关PH灰色文献报告，以便对PH干预措施的规划、实施和评估产生积极影响。该项目将由两部分组成：1)继续开发以用户为中心的技术系统，2)部署和评估该系统对县卫生部门卫生人力任务的影响。 该系统将自动收集基于网络的灰色文献报告(利用根据PH专业人员的输入训练的规则)，然后使用由PH专家验证的PH干预报告的基本要素的模型来生成丰富的PH灰色文献报告摘要(Turner等人，在出版社中)。在开发了一个利用自然语言查询和以结构化、基于模型的摘要显示搜索结果的用户界面后，该系统将被引入几个县卫生部门，并进行评估，以确定其对信息流和使用的影响。 该项目将包括对以下方面的内在评价：1)系统收集的灰色文献报告的适当性；2)基于公共卫生干预模型的代表完整报告的摘要的质量和充分性；3)使用精确度和召回率衡量用户查询的检索结果。外部评估将在参与纽约医学院正在进行的关于信息和有效性之间关系的研究的PH部门进行。这项研究将提供基线衡量标准。我们将评估：1)县卫生局人员检索报告的易用性和使用频率、通用性、准确性和完整性；2)基于县卫生部门内部结果衡量，系统的使用对信息流和使用的影响。 这里提出的工作既有公共卫生的使命，也有国家医学图书馆的使命 通过设计一个利用自然语言处理技术的信息系统来 为公共卫生工作人员有效地收集和提供高质量的公共卫生灰色文献。

DESCRIPTION (provided by applicant): The long-term objective of the proposed project is to provide the public health (PH) workforce with improved access to high quality, relevant PH grey literature reports in order to positively impact the planning, conducting, and evaluating of PH interventions. The project will consist of two components: 1) continuation of user-focused technical system development, and 2) deployment and evaluation of this system's impact on the tasks of the PH workforce in county health departments. The system will automatically harvest web-based grey literature reports (utilizing rules trained on input from PH professionals) and then produce rich summaries of PH grey literature reports using the model of essential elements of PH intervention reports validated by PH specialists (Turner et al, In Press). After developing a user interface that capitalizes on both natural language querying and the display of search results in a structured, model-based summary, the system will be introduced into several county health departments and evaluated to determine its impact on information flows and uses. The project will include intrinsic evaluations of: 1) the appropriateness of the grey literature reports harvested by the system; 2) the quality and sufficiency of summaries representing the full reports based on the PH intervention model and; 3) retrieval results for users' queries using metrics of precision and recall. Extrinsic evaluation will be done in PH departments participating in the New York Academy of Medicine's ongoing study of the relationship between information and effectiveness. The research will provide baseline measures. We will evaluate: 1) the ease and frequency of use, perceptions of currency, accuracy, and completeness of retrieved reports by county PH personnel, and; 2) impact of the system's usage on information flows and uses based on internal outcome measures within the county health departments. The work proposed here shares both the missions of public health and the National Library of Medicine through the design of an information system that exploits natural language processing technology to efficiently collect and provide access to quality public health grey literature for the public health workforce.