CAREER: Image-Based Rendering using Stereo Vision

本研究的目标是将计算机视觉技术，特别是立体视觉技术应用于基于图像的渲染（IBR）领域--基于现有图像合成场景新视图的问题。 长期目标是开发一个系统，从输入图像流中建立一个基于图像的场景表示，同时积极选择新的视点。具体的研究主题包括：IBR方法的新性能度量的发展;基于立体视觉的新IBR技术的发展;纹理合成技术在遮挡问题中的应用;视觉标记的利用;以及用于选择参考视点的在线和离线算法的开发。 本科生将积极参与研究项目的各个方面，包括实施，实验，撰写论文和参加会议。 通过将当前的研究主题整合到课程中，并通过使用在项目背景下创建的实验室设施，学生将从中受益。 PI的长期教育目标包括开发针对非科学专业学生的非传统课程，并建立与工业界的联系，以获得现实世界的观点。

The goal of this research is the application of computer visiontechniques, in particular stereo vision techniques, to the domain ofimage-based rendering (IBR) --- the problem of synthesizing novelviews of a scene based on existing images. The long-term goal is todevelop a system that builds an image-based scene representation froma stream of input images, while actively selecting new viewpoints.Specific topics of investigation will include: the development of newperformance measures for IBR methods; the development of new IBRtechniques based on stereo vision; the application of texturesynthesis techniques to occlusion issues; the utilization of visuallandmarks for calibration; and the development of on-line and off-linealgorithms for the selection of reference viewpoints. Undergraduate students will be involved significantly in allaspects of the research project, including implementation,experimentation, authoring papers, and attending conferences. Otherstudents will benefit through the integration of current researchtopics into the curriculum, and through use of the lab facilitiescreated in the context of the project. The PI's long-term educationalgoals include developing non-traditional courses aimed at students notordinarily specializing in the sciences, and establishing contacts toindustry for a real-world perspective.