Signal Processing Methods for Computational Displays

近年来，在从人机交互、医学、娱乐到汽车等多个领域的广泛虚拟、增强和混合现实应用的推动下，新一代光电显示器的研究不断加强，商业兴趣日益浓厚。显示硬件和计算机原始能力的稳步发展是学术界、工业界和华尔街对先进显示技术热情高涨的另一个重要催化剂。许多被认为昂贵得令人望而却步的显示功能现在可以以可接受的价格提供。就像发明纸张和印刷机对古代文明的重要性一样，先进的高科技显示技术的潜力怎么强调都不为过，它可能会塑造我们的交流、学习、游戏甚至行为的方式。*这项研究是为了推进我最近在时间心理视觉调制(TPVM)方面的开创性工作，这是一种计算显示的新范式，可能会通过可视化人机界面来彻底改变设计和用户体验。通过巧妙地将心理物理学、光电子学和人类视觉的数学模型相互作用，TPVM可以在同一显示介质上同时向多个用户呈现不同的、不受干扰的视图。它非常适合多用户协作虚拟现实(VR)和增强现实(AR)。与谷歌眼镜、Oculus‘s Rift和微软的Hololens不同，TPVM计算显示系统中的终端用户观看设备被简化为轻型、简单、显示同步的液晶眼镜。生成眼球跟踪3D虚拟环境所需的所有繁重计算和复杂的光学技术都委托给了一个功能强大的中央渲染引擎和高速显示器。除了VR/AR，TPVM还有其他令人兴奋的应用：反盗版显示，向后兼容的3D/2D显示，显示屏与摄像机之间的可见光通信，以及隐私保护显示。从科学和哲学上讲，全息应该是可能模糊心灵和身体边界的终极显示技术。但由于制作全息图的巨大工程困难，人们总是在寻找更实用的替代方案。最近，出现了一些未来的4D光场显示器，以Magic Leap的头戴式虚拟视网膜显示器和麻省理工学院媒体实验室的张量显示器为代表；两者都属于TPVM等计算显示器的范畴。在这项研究中，我还将展开一项学术追求，从理论上了解上述计算显示器的2D/3D信号表示能力。**

Recent years have seen intensified research on and burgeoning commercial interests in a new generation of optoelectronic displays, driven by a wide range of virtual, augmented and mixed reality applications in diversified fields from man-machine interactions, medicine, entertainment, to automobile, etc. Steady progress in the raw capabilities of display hardware and computers are the other important catalysts for the great enthusiasm in advanced display technologies on all sides: academia, industry and Wall Street. Many display functionalities that were considered prohibitively expensive can now be offered at acceptable costs. Just as the importance of inventing paper and printing machines to ancient civilizations, the potential of advanced high-tech display technologies cannot be overstated, which may shape the ways we communicate, learn, play, or even behave.******This research is to advance my recent ground-breaking work of temporal psychovisual modulation (TPVM), which is a new paradigm of computational display that can potentially revolutionize the design of and user experiences with visual man-machine interfaces. Through an ingenious interplay of psychophysics, optoelectronics and mathematical modeling of human vision, TPVM can present multiple users different interference-free views simultaneously on the same display medium. It is ideally suited for multiuser collaborative virtual reality (VR) and augmented reality (AR). Unlike Google Glasses, Oculus's Rift and Microsoft's Hololens, the end user viewing devices in the TPVM computational display system are simplified to light, simple, display-synchronized liquid crystal glasses. All heavy computations and complex optics required for generating eye-tracking 3D virtual environment are delegated to a central, powerful rendering engine and a high-speed display. Besides VR/AR, TPVM also has other exciting applications: anti-piracy displays, backward compatible 3D/2D displays, display-camera visible light communication, and privacy-protection displays.******Scientifically and philosophically speaking, holography should be the ultimate display technology that may threaten to blur the boundary of mind and body. But due to daunting engineering difficulties in making holograms, people always seek for more practical alternatives. Recently, some futuristic 4D light field displays emerged, represented by Magic Leap's head-mounted virtual retinal display and MIT Media Lab's tensor display; both fall into the category of computational displays like TPVM. In this research I will also launch an academic pursuit to gain theoretical understanding of the 2D/3D signal representation capacities of the aforementioned computational displays. **