NSF Convergence Accelerator Track E: Ocean Vision AI: Scaling up visual observations of life in the ocean using artificial intelligence

为了充分探索我们的海洋，发现生活在那里的生命，我们需要扩大我们的观察能力。为了满足这一需求，水下图像的收集速度远远超过了我们的处理能力，而使用人工智能的新技术至关重要。该项目名为海洋视觉人工智能（Ocean Vision AI），将通过结合成像、人工智能和开放数据方面的专业知识，并创建数据和分析管道，将像素转换为可操作的数据，从而加速水下图像的处理。海洋视觉人工智能将通过社区科学门户网站和基于游戏的教育计划，为海洋数据科学劳动力和公众参与提供多样化的机会。总之，海洋视觉人工智能将用于直接加速水下视觉数据的自动分析，使科学家、探险家、政策制定者、讲故事者和公众能够学习、理解和更多地关注生活在我们海洋中的生命。为了充分探索我们的海洋，发现生活在那里的生命，我们需要扩大我们在时间和空间上的观测能力。为了满足这一需求，水下成像作为海洋生物学的一种主要传感方式，正被部署在各种平台上。然而，随着越来越多的可视化数据被收集，社区面临着人工智能可能能够解决的数据分析积压问题。海洋视觉人工智能试图通过为使用成像、人工智能和开放数据进行研究的团体提供一个中心枢纽来满足这一需求；从现有的图像和视频数据存储库创建数据管道；提供项目协调工具；通过游戏开发利用公众参与和参与；并生成与研究人员以及其他开放数据存储库共享的数据产品。这些努力将在海洋生物学、渔业、生物海洋学、水下光学和计算机视觉、人工智能、海洋工程、生物力学、环境生物学、人机交互、基于游戏的教育和社区对科学的贡献等领域产生新的知识追求。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

In order to fully explore our ocean and discover the life that lives there, we need to scale up our observational capacity. To address this need, underwater imagery is being collected at rates that far exceed our ability to process them, and new techniques using artificial intelligence are critical. This project, Ocean Vision AI, will accelerate processing of underwater imagery by combining expertise in imaging, artificial intelligence, and open data, and creating data and analysis pipelines that convert pixels to actionable data. Ocean Vision AI will provide opportunities to diversify an ocean data science workforce and public engagement through community science portals and game-based education initiatives. Together, Ocean Vision AI will be used to directly accelerate the automated analysis of underwater visual data to enable scientists, explorers, policymakers, storytellers, and the public, to learn, understand, and care more about the life that inhabits our ocean. In order to fully explore our ocean and discover the life that lives there, we need to scale up our observational capabilities both in time and space. To address this need, underwater imaging, a major sensing modality for marine biology, is being deployed on a diverse array of platforms. However, as more visual data are collected, the community faces a data analysis backlog that artificial intelligence may be able to address. Ocean Vision AI seeks to address this need by providing a central hub for groups conducting research that use imaging, AI, and open data; create data pipelines from existing image and video data repositories; provide project tools for coordination; leverage public participation and engagement via game development; and generate data products that are shared with researchers as well as other open data repositories. These efforts will result in novel intellectual pursuits in fields as diverse as marine biology, fisheries, biological oceanography, underwater optics and computer vision, artificial intelligence, ocean engineering, biomechanics, environmental biology, human-computer interaction, game-based education, and community contributions to science.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.