Collaborative Research: CIBR: Leaping the Specimen Digitization Gap: Connecting Novel Tools, Machine Learning and Public Participation to Label Digitization Efforts

国家将自然历史收藏数字化的努力已将以前孤立的、未标准化的资源转变为可用于应对重大科学和社会挑战的联网的、公开可用的信息网络。尽管取得了这些巨大的进步，但数字化进程中的主要瓶颈仍然存在，特别是在自动化方法最具挑战性的领域。特别是，将模拟标本数据捕获为数字格式，并将收集地点的文字描述转换为可绘制地图的地理坐标，仍然是一项精品工作。由于这些瓶颈，多达91%的数字化标本缺少阻碍更有效地使用这些标本记录的能力的关键要素。该项目将开发关键的工作流程，以极大地提高捕获标本数据并向数据提供者和消费者广泛提供标本数据的速度。这些工作流程包括使用计算机和人类智能来提高我们捕获标本信息的能力的新方法。一个关键的工作流程侧重于将成像标本标签自动转换为适当格式和可用的数字文本的挑战。这一工作流程成功的关键是人类验证检查点，它将使用流行的公民科学平台--自然笔记--来实现。第二个工作流程侧重于新工具，这些工具利用先前的努力，根据样本收集位置分配可映射的坐标，以便为缺少这些数据的样本自动添加这种映射信息。最后，这项工作将创建工具，方便访问这些新数据进出常用数据库，使数据立即为博物馆提供者和研究人员所用。这一努力将把公众对科学的参与与这些新工具和技术联系起来。此外，它还将在生物信息学和博物馆科学方面培训不同的研究生和本科生。这项努力有三个设计目标，共同努力将极大地缩小博物馆标本数据的数字化差距。第一个设计目标是通过成功的自然笔记(NFN)项目，将机器学习方法与公众参与科学研究(PPSR)相结合，以加快标签数字化并促进获得当地数据。第一个设计目标的一个关键部分是在可能的情况下利用有监督的机器学习方法和对象字符识别(OCR)，但也包括使用NFN平台在关键点从人类志愿者那里收集快速质量反馈的“环中人”。这种方法还提供了一种方法，可以创建改进自动化步骤所需的高质量训练数据集，最终进一步减少人力投入。第二个设计目标将把通过地理定位进行的地点数据解释与生物多样性增强地点服务(BERS)结合起来，这将使人们能够利用最佳做法查找已有的地理参考地点。第三个目标是将这些工作流程和服务连接到社区数字化中心Symbiota，使内容能够轻松地流入和流出到数字化网络。供应商将能够轻松地访问新数据以及有关处理步骤的关联元数据，所有这些元数据都使用既定的标准和最佳实践返回。这一努力的关键是与社区的接触，包括研究人员、收藏工作人员和Zooniverse志愿者。参与将集中于虚拟培训和与咨询委员会的合作，以提高能力和社区参与。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

National efforts to digitize natural history collections have transformed previously siloed, unstandardized resources into a networked, openly available information nexus usable to meet grand scientific and societal challenges. Despite these enormous strides, major bottlenecks in this digitization process still exist, especially in areas where automation approaches have been most challenging. In particular, capturing analog specimen data into digital format and converting text descriptions of collecting locations into mappable geocoordinates, have remained boutique efforts. Because of these bottlenecks, as many as 91% of digitized specimens are missing key elements that hamper ability to use these specimen records more effectively. This project will develop key workflows to dramatically increase the speed at which specimen data can be captured and made available broadly to data providers and consumers. These workflows include novel approaches that use both computer and human intelligence to advance our ability to capture specimen information. One key workflow focuses on the challenge of automated conversion of imaged specimen labels into properly formatted and usable digital text. Critical to the success of this workflow are human validation checkpoints that will be implemented using a popular citizen science platform, Notes from Nature. A second workflow focuses on new tools that take advantage of previous efforts to assign mappable coordinates based on specimen collection location to automatically add such mapping information for specimens missing those data. Finally, this effort will create tools for easy access to these new data in and out of common use databases, making the data immediately available for museum providers and researchers alike. This effort will connect public participation in science to these novel tools and technologies. Further, it will train diverse graduate students and undergraduate students in bioinformatics and museum science.This effort has three design goals that together will dramatically reduce the digitization gap in museum specimen data. The first design goal will combine machine learning methods with public participation in scientific research (PPSR) via the successful Notes from Nature (NfN) project to speed up label digitization and facilitate obtaining locality data. A key part of the first design goal utilizes supervised machine learning approaches and object character recognition (OCR) when possible but also includes “humans in the loop” using the NfN platform to gather fast quality feedback from human volunteers at key points. This approach also provides a means to create high-quality training datasets needed for improving automation steps, ultimately further reducing human effort. The second design goal will integrate locality data interpretation through GEOLocate with a Biodiversity Enhanced Locality Service (BELS), which will make it possible to look up pre-existing localities that have been georeferenced using best practices. A third goal is to connect these workflows and services to Symbiota, a community digitization hub, to allow easy inflow and outflow of content back to digitization networks. Providers will be able to easily access new data along with associated metadata about processing steps, all returned using established standards and best practices. The key to this effort will be engagement with the community, including researchers, collections staff, and Zooniverse volunteers. Engagement will focus on virtual training and working with an advisory committee in order to grow capacity and community involvement.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.