SBIR Phase I: Subtractive-waveguide based Display for Augmented Reality Smart Glasses using Spatial-temporal Multiplexed Single-CMOS Panels

这个小型企业创新研究(SBIR)第一阶段项目的更广泛影响是实现了智能眼镜的增强现实(AR)显示器，可以在包括黑色在内的全动态范围内显示数字内容。目前AR智能眼镜中使用的传统光学组件会使数字内容看起来半透明，因此缺乏真实感。拟议的工作是开发一种显示技术，该技术可以控制虚拟图像平面、虚拟对象和黑色3D全息图中的每像素透明度。全息图中黑色部分的光遮挡可以在背景现实上显示为真实的物理对象。使用这种方法，每个显示像素可以根据用户的意愿变为黑色、半透明或透明，使得即使在阳光直射的环境中也可以看到数字内容。该SBIR第一阶段项目提出了一种用于AR智能眼镜的整体显示解决方案，该方案包括三个关键元素：基于空间多路复用全内反射的减去波导组合器；由两个空间多路复用光源照明的单个光反射空间光调制器(SLM)；以及时间多路复用算法，其中两个空间多路复用光源可以在其专用的子帧时间内被SLM选择性地调制。由于像素级透明度控制允许硬边缘遮挡，因此所提出的智能时空多路复用方法使得仅使用单个硅显示面板即可实现像素级硬边缘遮挡的单个显示器，从而降低了成本和复杂性，同时提高了透视效率和电池寿命性能。这些技术改进是行业第一次，共同满足了户外光线充足场景的AR设备的市场需求。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact of this Small Business Innovation Research (SBIR) Phase I project is the realization of Augmented Reality (AR) displays for smart glasses that can show digital content in the full dynamic range, including the black color. The conventional optical components currently used in AR smart glasses cause the digital content to appear translucent and, hence, lack realism. The proposed work is on developing a display technology that controls per-pixel transparency in the virtual image plane, virtual objects, and 3D holograms for black color. The blocking of light for black-colored parts in a hologram can show as realistic physical objects over the background reality. Using this approach, each display pixel can be made black, semi-transparent, or transparent at a user’s will, making visibility of digital content possible even in direct sun-lit environments.This SBIR Phase I project proposes a holistic display solution for AR smart glasses that consists of three key elements: a spatially-multiplexed Total Internal Reflection–based subtractive-waveguide combiner; a single photo-reflective spatial light modulator (SLM) that is illuminated by two spatially-multiplexed illuminants; and a temporal multiplexing algorithm whereby the two spatially-multiplexed illuminants can be selectively modulated by the SLM during their dedicated sub-frame times. Since pixel-wise transparency control allows hard-edge occlusion, hence the proposed smart spatiotemporal multiplexed approach enables a single display that achieves pixel-wise hard-edge occlusion using only a single silicon display panel, thereby reducing cost and complexity while increasing see-through efficiency and battery life performance. These technological improvements are industry firsts and together allow for addressing a market need for AR devices for outdoor well-lit scenarios.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.