CAREER: Spectral Deformable Models: Theory and Applications

随着实时3D/4D数据捕获能力的普及，出现了通过网络计算可变形模型的需求。传统的模型驱动可变形模型由于不能有效地求解大规模数据集的空间信息并在不同的网络条件下自适应地最小化而存在瓶颈。该项目的中心是光谱驱动的可变形模型的概念。类似于傅立叶分析应用于图像处理，谱变形模型采用流形谐波来高效地执行3D变形表面和体积的分割、配准、基于物理的模拟、压缩和流式传输。在该项目中，流形谐波用于将任意扫描数据集变换到简化的扩散子空间中，其中实时分割、配准、基于物理的模拟、压缩和流式传输是基于流形谐波的。并且可以执行基于物理的仿真。除了拉伸变形之外，旋转场和张量场还使用多种谐波进行编码，这提供了一种“频谱多分辨率”结构，可以在不同的网络条件下压缩和流式传输可变形模型。PI与UT西南医学中心的医学成像专家合作，构建了一个远程诊断系统，用于评估频谱可变形模型中的每个分量。远程医疗试验台对下一代诊断和治疗服务以及临床教育产生了影响。理论和技术的突破可以造福我们的社会，从远程沉浸，遥感，语音训练，通过PI？的进一步推广活动。通过将研究进展纳入现有和未来的课程，将研究和教育整合在一起;开发教育可视化软件;吸引更多的本科生参与研究。

With the popularity of real-time 3D/4D data capturing capabilities, there is an emerging need to compute the deformable models over the networks. Traditional model-driven deformable models have their bottlenecks since the spatial information for large-scale datasets cannot be efficiently solved and adaptively minimized over different network conditions. This project centers on the concept of spectrum-driven deformable models. Analogous to Fourier analysis being applied to image processing, the spectral deformable models employ manifold harmonics to efficiently and effectively perform segmentation, registration, physics-based simulation, compression, and streaming of 3D deformable surfaces and volumes.In this project, manifold harmonics are used to transform arbitrary scanned datasets into a reduced diffusion subspace, in which real-time segmentation, registration, and physics-based simulation can be performed. Besides the stretching deformations, the rotational and tensor fields are encoded with manifold harmonics, which provides a "spectral multiresolution" structure to compress and stream deformable models over different network conditions.The PI works with the medical imaging experts at UT Southwestern Medical Center, to build a tele-diagnosis system for evaluating each component in the spectral deformable models. The test-bed on tele-medicine has impacts on the next-generation diagnosis and treatment services, as well as on clinical education. The theoretical and technical breakthrough can benefit our society at large, from tele-immersion, remote sensing, to speech training, through the PI?s further outreach activities. The research and education are integrated by taking research advances into existing and future courses; developing the visualization software for education; and attracting more undergraduate students into research.