Signal Processing Methods for Computational Displays

近年来，在从人机交互、医学、娱乐到汽车的各种领域中的广泛的虚拟、增强和混合现实应用的推动下，对新一代光电显示器的研究得到了加强，商业兴趣也在迅速增长。显示器硬件和计算机的原始能力的稳步发展是高级显示器的巨大热情的另一个重要催化剂各方面的技术：学术界、工业界和华尔街。许多被认为过于昂贵的显示功能现在可以以可接受的成本提供。 就像发明纸张和印刷机对古代文明的重要性一样，先进的高科技显示技术的潜力怎么强调都不为过，它可能会塑造我们沟通、学习、娱乐甚至行为的方式。这项研究是为了推进我最近的开创性工作的时间心理视觉调制（TPVM），这是一个新的计算显示范式，可以潜在地革命性的设计和用户体验与视觉人机界面。通过心理物理学、光电子学和人类视觉数学建模的巧妙相互作用，TPVM可以在同一显示介质上同时向多个用户呈现不同的无干扰视图。它非常适合多用户协作虚拟现实（VR）和增强现实（AR）。 与谷歌眼镜、Oculus的Rift和微软的Hololens不同，TPVM计算显示系统中的终端用户观看设备被简化为轻便、简单、显示同步的液晶眼镜。 生成眼睛跟踪3D虚拟环境所需的所有繁重计算和复杂光学器件都委托给中央、强大的渲染引擎和高速显示器。除了VR/AR，TPVM还有其他令人兴奋的应用：反盗版显示器，向后兼容的3D/2D显示器，显示器-摄像机可见光通信和隐私保护显示器。从科学和医学的角度来说，全息摄影应该是最终的显示技术，它可能会模糊心灵和身体的界限。 但由于全息图制作的工程困难，人们总是寻求更实用的替代品。最近，出现了一些未来派的4D光场显示器，以Magic Leap的头戴式虚拟视网膜显示器和MIT媒体实验室的张量显示器为代表;两者都属于TPVM等计算显示器的范畴。在这项研究中，我还将开展一项学术研究，以获得对上述计算显示器的2D/3D信号表示能力的理论理解。**

Recent years have seen intensified research on and burgeoning commercial interests in a new generation of optoelectronic displays, driven by a wide range of virtual, augmented and mixed reality applications in diversified fields from man-machine interactions, medicine, entertainment, to automobile, etc. Steady progress in the raw capabilities of display hardware and computers are the other important catalysts for the great enthusiasm in advanced display technologies on all sides: academia, industry and Wall Street. Many display functionalities that were considered prohibitively expensive can now be offered at acceptable costs. Just as the importance of inventing paper and printing machines to ancient civilizations, the potential of advanced high-tech display technologies cannot be overstated, which may shape the ways we communicate, learn, play, or even behave.******This research is to advance my recent ground-breaking work of temporal psychovisual modulation (TPVM), which is a new paradigm of computational display that can potentially revolutionize the design of and user experiences with visual man-machine interfaces. Through an ingenious interplay of psychophysics, optoelectronics and mathematical modeling of human vision, TPVM can present multiple users different interference-free views simultaneously on the same display medium. It is ideally suited for multiuser collaborative virtual reality (VR) and augmented reality (AR). Unlike Google Glasses, Oculus's Rift and Microsoft's Hololens, the end user viewing devices in the TPVM computational display system are simplified to light, simple, display-synchronized liquid crystal glasses. All heavy computations and complex optics required for generating eye-tracking 3D virtual environment are delegated to a central, powerful rendering engine and a high-speed display. Besides VR/AR, TPVM also has other exciting applications: anti-piracy displays, backward compatible 3D/2D displays, display-camera visible light communication, and privacy-protection displays.******Scientifically and philosophically speaking, holography should be the ultimate display technology that may threaten to blur the boundary of mind and body. But due to daunting engineering difficulties in making holograms, people always seek for more practical alternatives. Recently, some futuristic 4D light field displays emerged, represented by Magic Leap's head-mounted virtual retinal display and MIT Media Lab's tensor display; both fall into the category of computational displays like TPVM. In this research I will also launch an academic pursuit to gain theoretical understanding of the 2D/3D signal representation capacities of the aforementioned computational displays. **