Collaborative Research: Frameworks: Automated Quality Assurance and Quality Control for the StraboSpot Geologic Information System and Observational Data

地质数据的数字化收集和存储使其能够被发现和访问。然而，为了使数据能够重复使用和复制，需要对数据的质量和/或对收集数据的人的信任进行某种评价，本项目的重点是开发一个自动化系统，用于评价收集的数据的质量和观察结果的完整性。这包括开发两种方法-一种基于机器学习，另一种基于专家逻辑-来评估数据质量。此外，该项目还涉及在实地数据和实验室数据两个领域测试方法，以确保这些方法适用于不同的数据类型。还将提供一个机制，使科学家能够评价现有的数据库，并在数据收集工作进行时改进数据收集工作。这些评估对于专家用户重复使用和复制观测结果以及普通公众和非专业专家识别高质量和完整的数据收集至关重要。该项目致力于为基于观测的地质数据提供自动化QAQC（质量评估/质量控制）系统的转型任务。该方法集成了计算机科学，认知科学和地质学专业知识，以开发实现QAQC系统的算法。这些CI资源的基础是StraboSpot地质信息系统。项目活动包括开发两种互补算法-一种基于机器学习，另一种基于专家逻辑-以评估观测数据。将进行专家测试以提高算法性能。还将开发一个图形用户界面，使地质工作者能够在数据收集期间评估其他人的数据集并改进自己的数据集。这种方法可以实现新的科学，包括：1）在区域范围内授权建模，单个地质学家或团队可以通过使用可信的共享数据来实现; 2）允许一个领域的专家将其专业知识之外的数据纳入模型或解释，而不必学习如何收集数据和/或评估其他人的数据质量。因此，拟议的工作将促进和便利在学科内部和学科之间使用共享数据集。QAQC系统设计的迭代，协作过程将作为社区建设的奋进。NSF高级网络基础设施办公室的这一奖项由研究，创新，协同和教育部（RISE），地球科学部（ESTA），该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的学术价值和更广泛的影响审查标准。

Digital collection and storage of geological data allow for it to be findable and accessible. For the data to be reusable and reproducible, however, there needs to be some evaluation of the quality of the data and/or trust in the person who collected it. This project focuses on developing an automated system for evaluating the quality of collected data and the completeness of observations. This includes the development of two methods - one based on machine learning and one on logic derived from experts - to evaluate data quality. Furthermore, the project involves testing methods in two areas – field- and lab-based data – to ensure that the methodologies apply to different data types. A mechanism will also be provided that allows scientists to evaluate existing databases and improve data collection while it is occurring. These assessments are essential for expert users to reuse and reproduce observations and for the general public and non-disciplinary experts to recognize high-quality and complete data collections.This project addresses the transformational task of providing an automated QAQC (Quality Assessment/Quality Control) system for observationally-based geological data. The approach integrates Computer Science, Cognitive Science, and Geology expertise to develop algorithms to implement a QAQC system. The basis of these CI resources is the StraboSpot geologic information system. Project activities include the development of two complementary algorithms – one based on machine learning and one on logic derived from experts – to evaluate observational data. Expert testing will be done to improve algorithmic performance. A GUI (Graphical User Interface) will also be developed to allow geology practitioners to evaluate others’ datasets and improve their own during data collection. This approach enables new kinds of science, including: 1) empowering modeling at a regional scale beyond which a single geologist or team could achieve through their use of trusted shared data; and 2) allowing experts in one area to incorporate data outside of their expertise into a model or interpretation, without having to learn how to collect the data and or assess someone else’s data quality. Thus, the proposed work will promote and facilitate using shared data sets within and between disciplines. The iterative, collaborative process through which the QAQC system is designed will serve as a community-building endeavor.This award by the NSF Office of Advanced Cyberinfrastructure is jointly supported by the Division of Research, Innovation, Synergies, and Education (RISE), the Division of Earth Sciences (EAR), and the Tectonics Program within the NSF Directorate for Geosciences.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.