CAREER: Spectral Deformable Models: Theory and Applications

随着实时3D/4D数据捕获功能的普及，在网络上计算可变形模型的需求正在出现。传统的模型驱动的可变形模型在不同的网络条件下不能有效地求解和自适应最小化大规模数据集的空间信息，存在一定的瓶颈。这个项目的核心是频谱驱动的可变形模型的概念。与应用于图像处理的傅里叶分析类似，光谱可变形模型利用流形谐波来高效地执行分割、配准、基于物理的模拟、压缩和3D可变形表面和体积的流。在这个项目中，流形谐波被用来将任意扫描数据集转换成一个简化的扩散子空间，在这个子空间中可以进行实时分割、配准和基于物理的模拟。除了拉伸变形外，旋转场和张量场还被编码为流形谐波，这提供了一种“谱多分辨率”结构，可以在不同的网络条件下压缩和传输可变形模型。PI与德克萨斯大学西南医学中心的医学成像专家合作，建立一个远程诊断系统，用于评估光谱变形模型中的每个组件。远程医疗试验台不仅对下一代诊疗服务产生影响，而且对临床教育产生影响。理论和技术上的突破可以使我们整个社会受益，从远程沉浸，遥感到语音训练，通过PI？S进一步开展外联活动。通过将研究进展纳入现有和未来的课程，将研究和教育相结合；开发教育可视化软件；并吸引更多的本科生参与研究。

With the popularity of real-time 3D/4D data capturing capabilities, there is an emerging need to compute the deformable models over the networks. Traditional model-driven deformable models have their bottlenecks since the spatial information for large-scale datasets cannot be efficiently solved and adaptively minimized over different network conditions. This project centers on the concept of spectrum-driven deformable models. Analogous to Fourier analysis being applied to image processing, the spectral deformable models employ manifold harmonics to efficiently and effectively perform segmentation, registration, physics-based simulation, compression, and streaming of 3D deformable surfaces and volumes.In this project, manifold harmonics are used to transform arbitrary scanned datasets into a reduced diffusion subspace, in which real-time segmentation, registration, and physics-based simulation can be performed. Besides the stretching deformations, the rotational and tensor fields are encoded with manifold harmonics, which provides a "spectral multiresolution" structure to compress and stream deformable models over different network conditions.The PI works with the medical imaging experts at UT Southwestern Medical Center, to build a tele-diagnosis system for evaluating each component in the spectral deformable models. The test-bed on tele-medicine has impacts on the next-generation diagnosis and treatment services, as well as on clinical education. The theoretical and technical breakthrough can benefit our society at large, from tele-immersion, remote sensing, to speech training, through the PI?s further outreach activities. The research and education are integrated by taking research advances into existing and future courses; developing the visualization software for education; and attracting more undergraduate students into research.