Collaborative Research: CIBR: Leaping the Specimen Digitization Gap: Connecting Novel Tools, Machine Learning and Public Participation to Label Digitization Efforts

国家数字化自然历史收藏的努力已经将以前孤立的、非标准化的资源转变为一个网络化的、公开可用的信息网络，可用于应对重大的科学和社会挑战。尽管取得了这些巨大的进步，但数字化过程中的主要瓶颈仍然存在，特别是在自动化方法最具挑战性的领域。特别是，将模拟标本数据捕获为数字格式，并将收集地点的文本描述转换为可测绘的地理坐标，仍然是精品工作。由于这些瓶颈，多达91%的数字化标本缺少阻碍更有效地使用这些标本记录的关键元素。该项目将制定关键工作流程，以大幅提高采集标本数据的速度，并将其广泛提供给数据提供者和消费者。这些工作流程包括使用计算机和人类智能来提高我们捕获标本信息的能力的新方法。一个关键的工作流程侧重于将图像标本标签自动转换为正确格式和可用的数字文本的挑战。该工作流程成功的关键是人工验证检查点，将使用流行的公民科学平台“自然笔记”来实现。第二个工作流程侧重于新工具，该工具利用以前的工作来分配基于标本采集位置的可映射坐标，以自动为缺少这些数据的标本添加此类映射信息。最后，这项工作将创建工具，方便地访问这些新数据进出常用数据库，使数据立即可供博物馆提供者和研究人员使用。这一努力将把公众参与科学与这些新工具和技术联系起来。此外，它将在生物信息学和博物馆科学方面培养多样化的研究生和本科生。这项工作有三个设计目标，它们将大大减少博物馆标本数据的数字化差距。第一个设计目标将通过成功的自然笔记（NfN）项目将机器学习方法与公众参与科学研究（PPSR）相结合，以加速标签数字化并促进获取局部数据。第一个设计目标的关键部分在可能的情况下利用监督机器学习方法和对象字符识别（OCR），但也包括使用NfN平台从人类志愿者那里收集关键点的快速质量反馈的“人类在循环”。这种方法还提供了一种创建高质量训练数据集的方法，这些数据集用于改进自动化步骤，最终进一步减少人力。第二个设计目标是通过地理定位将位置数据解释与生物多样性增强位置服务（BELS）结合起来，这将使查找使用最佳实践进行地理参考的已有位置成为可能。第三个目标是将这些工作流程和服务连接到Symbiota，一个社区数字化中心，允许内容轻松流入和流出到数字化网络。提供者将能够轻松访问新数据以及有关处理步骤的相关元数据，所有这些都使用已建立的标准和最佳实践返回。这一努力的关键将是与社区的合作，包括研究人员、收集人员和Zooniverse志愿者。参与将侧重于虚拟培训和与咨询委员会合作，以提高能力和社区参与。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

National efforts to digitize natural history collections have transformed previously siloed, unstandardized resources into a networked, openly available information nexus usable to meet grand scientific and societal challenges. Despite these enormous strides, major bottlenecks in this digitization process still exist, especially in areas where automation approaches have been most challenging. In particular, capturing analog specimen data into digital format and converting text descriptions of collecting locations into mappable geocoordinates, have remained boutique efforts. Because of these bottlenecks, as many as 91% of digitized specimens are missing key elements that hamper ability to use these specimen records more effectively. This project will develop key workflows to dramatically increase the speed at which specimen data can be captured and made available broadly to data providers and consumers. These workflows include novel approaches that use both computer and human intelligence to advance our ability to capture specimen information. One key workflow focuses on the challenge of automated conversion of imaged specimen labels into properly formatted and usable digital text. Critical to the success of this workflow are human validation checkpoints that will be implemented using a popular citizen science platform, Notes from Nature. A second workflow focuses on new tools that take advantage of previous efforts to assign mappable coordinates based on specimen collection location to automatically add such mapping information for specimens missing those data. Finally, this effort will create tools for easy access to these new data in and out of common use databases, making the data immediately available for museum providers and researchers alike. This effort will connect public participation in science to these novel tools and technologies. Further, it will train diverse graduate students and undergraduate students in bioinformatics and museum science.This effort has three design goals that together will dramatically reduce the digitization gap in museum specimen data. The first design goal will combine machine learning methods with public participation in scientific research (PPSR) via the successful Notes from Nature (NfN) project to speed up label digitization and facilitate obtaining locality data. A key part of the first design goal utilizes supervised machine learning approaches and object character recognition (OCR) when possible but also includes “humans in the loop” using the NfN platform to gather fast quality feedback from human volunteers at key points. This approach also provides a means to create high-quality training datasets needed for improving automation steps, ultimately further reducing human effort. The second design goal will integrate locality data interpretation through GEOLocate with a Biodiversity Enhanced Locality Service (BELS), which will make it possible to look up pre-existing localities that have been georeferenced using best practices. A third goal is to connect these workflows and services to Symbiota, a community digitization hub, to allow easy inflow and outflow of content back to digitization networks. Providers will be able to easily access new data along with associated metadata about processing steps, all returned using established standards and best practices. The key to this effort will be engagement with the community, including researchers, collections staff, and Zooniverse volunteers. Engagement will focus on virtual training and working with an advisory committee in order to grow capacity and community involvement.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.