Static and Dynamic Hyperspectral Image Analysis and Synthesis

点击翻译按钮获取中文摘要

My long term research goal is to explore opportunities to create novel algorithms using physically correct methods for computer vision (CV) and for modelling and animating physical phenomena. Physically correct methods refer to computer vision methods that are consistent with principles in optics and in geometry. My underwater imaging work motivates my proposed research into investigating the computer vision issues of refraction of more than 3 wavelengths. The refraction of light occurs when light traverses from one medium to another medium with a different refractive index. The value of  refractive index depends on the wavelength of light and on the temperature of the medium. Cameras are designed based on the principle of refraction. Refraction also occurs naturally in transparent objects such as in glasses, and in water. Mirage is a naturally occurring phenomenon in which the temperature gradient of air causes the refraction of light, which is also known as thermal-optical  or photothermal deflection. Interestingly, by clever manipulation of the thermal gradient, an object can be made invisible. The area of CV that uses multiple wavelengths or bands is called multispectral imaging, when the number of bands N is small (N> 100. To simplify discussion, the term MH imaging includes multispectral, hyperspectral and thermal imaging. In the next five years, I plan to focus my efforts on issues related to MH imaging in developing physically correct methods for CV, in particular, in dispersive media. My short term objectives include: 1) identifying issues and constraints for MH imaging in CV and in developing a physically correct framework for using multiple wavelengths, 2) using the framework to develop physically correct CV algorithms for land and for the underwater environment, 3) developing new algorithms in MH structured light techniques, and 4) extracting MH features for classification and for modeling and rendering of realistic objects. For objective 1, issues with MH images will be identified and existing constraints used in CV will be evaluated for application in MH imaging. Specifically, I expect that there will be issues related to the image formation process, e.g. refraction, or to the type of camera. For objective 2, I plan to select several important existing CV algorithms, in particular, those that were developed in my lab, and extend them to the MH environment. For objective 3,  I plan to develop structured light systems that use more than 3 wavelengths. For objective 4, I plan to investigate MH features captured in a dispersive environment that are useful for classification and other computer vision algorithms, e.g. shape from shading.