SGEER: Exploratory Research on Analyzing Forward-Scan Sonar Video Imagery by Computer Vision Techniques

这个为期一年的SGER项目将探索从运动方法到声像图像的结构应用的数学模型。计算机声纳处理主要局限于通过利用二维纹理或对象/阴影形状线索来进行场景/目标检测、分割、分类和识别的经典单帧方法。很少有工作探索多视角用于三维目标重建的潜在用途，随着在低能见度条件下产生高分辨率视频的高频声学摄像机变得越来越可用，这一点变得相当重要。其具体目标是探索声纳投影和运动模型，以制定各种三维形状和运动估计方法，推导基于模型的解决方案，确定一些有希望的方法来设计计算机视频分析和解释技术，以及更广泛地发展对声纳数据处理中的复杂性的理解。该研究项目的更广泛影响包括为实现水下自动测绘、无人水下航行器的基于图像的定位和导航、航行器制导和控制、目标分类和识别等方面的关键能力奠定基础，最终为包括海底科学研究和探索在内的一系列不同应用更有效和更高效地部署水下成像平台。此外，技术发展将导致1)加强声纳视频技术，以实现分析结果所预测的最佳性能，以及2)促进视觉和声纳界之间的合作，采取更多样化的方法，这是建立声纳视频处理作为一门更成熟的学科所必需的。

This one-year SGER project will explore mathematical models for the application of structure from motion methods to acoustic video imagery. Computer sonar processing has been dominantly limited to classical single frame methods for scene/target detection, segmentation, classification and identification by exploiting 2-D texture or object/shadow shape cues. Little, if any, work has explored the potential use of multiple views for 3-D target reconstruction, which is becoming rather important as high-frequency acoustic cameras producing high-resolution video in low visibility conditions are becoming increasingly more available. The specific goals are to explore sonar projection and motion models in the formulation of various 3-D shape and motion estimation methods, derivation of model-based solutions, identification of some promising approaches for devising computer video analysis and interpretation techniques, and more generally developing a better understanding of the complexities in the processing of sonar data. The research project's broader impacts comprise establishing the foundation to realize critical capabilities in automated underwater mapping, image-based positioning and navigation ofunmanned underwater vehicles, vehicle guidance and control, target classification and recognition, etc., eventually enabling more effective and efficient day-today deployment of underwater imaging platforms for a range of diverse applications, including benthic scientific research and exploration. Furthermore, technical developments will lead to 1) enhancing the sonar video technology for optimum performance as predicted by analytical results, and 2) promoting collaboration between vision and sonar communities with more diversified approaches that are necessary to establish sonar video processing as a more mature discipline.