Detecting and Analyzing Discontinuities in Computer Vision

该项目的研究将开发稳健和有效的算法来检测和分析有意义的图像间断，这是关键线索，在建立一般的图像理解系统中起着重要作用。该项目将建立在前景看好的多闪光成像初步研究的基础上，该成像使用主动照明来实现图像中深度不连续的稳健检测和标记。这些想法将通过改变照明参数的各个方面和开发处理更广泛种类的成像条件的方法来推广。该研究将通过将视点变化与主动照明相结合来开发一个健壮的多视点立体视觉框架，并将该概念扩展到开发用于检测和分析其他类型的有意义的不连续(表面法线、光照、运动等)的方法。为了实现这些目标，将使用多种图像捕获设计和方法进行广泛的数据收集和实验，以检测和分析不连续性。这项研究将使工程、医学、艺术和娱乐领域的各种短期和长期应用成为可能。用于实验的真实和合成数据将通过网络与研究社区公开共享，用于比较和评估技术的指标和软件也将共享。该项目的教育影响包括研究生和本科生的参与，以及将开发的与研究主题有关的新的研讨会课程。该项目将通过招募本科生研究人员和短期研究生来解决多样性问题，这些项目旨在增加未被充分代表的学生在科学和工程领域的参与，并计划在计算机科学以外的领域与同事和学生合作，目前这些领域的女性代表更多。

The research in this project will develop robust and effective algorithms for detecting and analyzing meaningful image discontinuities, which are critical cues that play an important part in building general image understanding systems. The project will build on promising preliminary research on multi-flash imaging, which uses active illumination to achieve robust detection and labeling of depth discontinuities in images. These ideas will be generalized by varying various aspects of the illumination parameters and developing methods to handle a much wider variety of imaging conditions. The research will develop a framework for robust multi-view stereo by integrating viewpoint variation with active illumination, and it will extend the concept to develop methods for detecting and analyzing other kinds of meaningful discontinuities (in surface normal, illumination, motion, etc.). To pursue these objectives, extensive data collection and experimentation will be performed with a number of image capture designs and methods for detecting and analyzing discontinuities. The research will enable a variety of both short-term and long-term applications in engineering, medicine, art, and entertainment. Real and synthetic data for experiments will be shared publicly with the research community via the web, as will metrics and software for comparing and evaluating techniques. The educational impacts of the project include the involvement of graduate and undergraduate students and new seminar courses that will be developed related to the research theme. The project will address diversity issues by recruiting undergraduate researchers and short-term graduate students through programs that aim to increase the involvement of underrepresented students in science and engineering, and also by the planned collaborations with colleagues and students in areas outside of Computer Science where women are currently better represented.