Perceptually and probabilistically guided multimedia

在接下来的五年里，我将开发生物和概率激励的多媒体系统，其中包括以下新的进步： (I)3D医学图像分析中的概率和感知因素，扩展了随机游动和高斯形状建模等技术，以更好地表示与婴儿大脑、脊髓等相关的特定医疗条件，从而改进分割技术。 (2)在三维点云简化过程中融入轮廓感知。 (Iii)扩展为网格数据结构开发的无线3D传输策略，以与点云表示一起工作。 (Iv)使用简单的、广泛可用的物体(如球体)并结合传感器数据来校准和同步多摄像机环境，以创建动态的综合3D场景。 (V)设计优化的周边视觉立体显示器。 (Vi)感知引导运动捕获(MOCAP)数据压缩，目标是即使在手持蜂窝设备上也能实现实时解压缩。 我工作的意义将在于： (A)稳健的3D医学图像分割和地面真实点生成算法。 (B)在3D多媒体传输和可视化中降低带宽、存储需求和优化感知质量；以及在全景3D电视中的应用。 (C)在丢包情况下稳健的3D传输策略；改进了无线设备上的3D教育娱乐。 (D)相机网络的可靠校准和智能协调，从而能够更好地捕捉3D自由视点视频。 (E)在教育娱乐中开发更好的互动3D环境。

Over the next five years I will develop biologically and probabilistically motivated multimedia systems that include the following novel advancements: (i) Probabilistic and perceptual factors in 3D medical image analysis, extending techniques, such as random walks and Gaussian shape modeling, to better represent specific medical conditions related to infant brain, spinal cord etc., and thereby improve segmentation techniques. (ii) Incorporate the perception of silhouettes in the process of 3D point cloud simplification. (iii) Extend wireless 3D transmission strategies developed for mesh data structures to work with point-cloud representations. (iv) Calibration and synchronization of multi-camera environments using simple, widely available objects (such as a globe) and combining sensor data to create a dynamic integrated 3D scene. (v) Designing optimized peripheral vision stereo displays. (vi) Perceptually guided Motion Capture (MoCap) data compression, with the goal of making real-time decompression feasible even on hand-held cellular devices. The significance of my work will lie in: (a) Robust 3D medical image segmentation and ground truth generation algorithms. (b) Reducing bandwidth, memory requirements and optimizing perceptual quality in 3D multimedia transmission and visualization; with applications in panoramic 3D TVs. (c) Robust 3D transmission strategies under packet loss; resulting in improved 3D edutainment over wireless devices. (d) Robust calibration and intelligent coordination of a network of cameras, allowing better 3D free-viewpoint video capture. (e) Developing better interactive 3D environments in Edutainment.