SBIR Phase I: Subtractive-waveguide based Display for Augmented Reality Smart Glasses using Spatial-temporal Multiplexed Single-CMOS Panels

这个小企业创新研究（SBIR）第一阶段项目的更广泛影响是实现了用于智能眼镜的增强现实（AR）显示器，可以在包括黑色在内的全动态范围内显示数字内容。目前在AR智能眼镜中使用的传统光学元件使数字内容看起来是半透明的，因此缺乏真实感。提议的工作是开发一种显示技术，可以控制虚拟图像平面、虚拟对象和黑色3D全息图的每像素透明度。在全息图中，黑色部分的光阻塞可以在背景现实上显示为逼真的物理对象。使用这种方法，可以根据用户的意愿将每个显示像素设置为黑色、半透明或透明，即使在阳光直射的环境中也可以看到数字内容。该SBIR一期项目提出了AR智能眼镜的整体显示解决方案，该解决方案由三个关键要素组成：基于全内反射的空间复用减法波导组合器；由两个空间多路光源照射的单个光反射空间光调制器（SLM）；以及时间复用算法，其中两个空间复用的光源可以在其专用子帧时间内由SLM选择性地调制。由于像素透明度控制允许硬边缘遮挡，因此提出的智能时空复用方法使单个显示器仅使用单个硅显示面板即可实现像素硬边缘遮挡，从而降低成本和复杂性，同时提高透视效率和电池寿命性能。这些技术改进是行业首创，共同解决了市场对户外光线充足的AR设备的需求。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact of this Small Business Innovation Research (SBIR) Phase I project is the realization of Augmented Reality (AR) displays for smart glasses that can show digital content in the full dynamic range, including the black color. The conventional optical components currently used in AR smart glasses cause the digital content to appear translucent and, hence, lack realism. The proposed work is on developing a display technology that controls per-pixel transparency in the virtual image plane, virtual objects, and 3D holograms for black color. The blocking of light for black-colored parts in a hologram can show as realistic physical objects over the background reality. Using this approach, each display pixel can be made black, semi-transparent, or transparent at a user’s will, making visibility of digital content possible even in direct sun-lit environments.This SBIR Phase I project proposes a holistic display solution for AR smart glasses that consists of three key elements: a spatially-multiplexed Total Internal Reflection–based subtractive-waveguide combiner; a single photo-reflective spatial light modulator (SLM) that is illuminated by two spatially-multiplexed illuminants; and a temporal multiplexing algorithm whereby the two spatially-multiplexed illuminants can be selectively modulated by the SLM during their dedicated sub-frame times. Since pixel-wise transparency control allows hard-edge occlusion, hence the proposed smart spatiotemporal multiplexed approach enables a single display that achieves pixel-wise hard-edge occlusion using only a single silicon display panel, thereby reducing cost and complexity while increasing see-through efficiency and battery life performance. These technological improvements are industry firsts and together allow for addressing a market need for AR devices for outdoor well-lit scenarios.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.