I-Corps: Translation Potential of Bidirectional Neural Communication for Extended Reality Technologies

I-Corps项目的更广泛影响是开发集成可穿戴生物医学传感器的下一代扩展现实技术。增强现实/虚拟现实（AR/VR）头显的可穿戴技术的发展有可能改变人们使用和接受这些技术的方式。通过创建一个依赖于用户反馈的控制器平台，人们可以与更友好的设备进行交互。此外，这些设备检测材料的能力可以让用户使用自然手势与虚拟物体进行交互。通过提高对人类行为的理解和反应，这些设备将使AR/VR体验更加身临其境和愉快。总的来说，这一进步使用户更接近无缝地融合现实世界和虚拟世界，有可能使这些技术更容易获得和有益。这个I-Corps项目利用体验式学习和对行业生态系统的第一手调查来评估该技术的翻译潜力。该解决方案是基于开发一种具有成本效益的防水碳传感器，用于增强现实/虚拟现实（AR/VR）耳机。这种传感器将收集眼球运动（眼电图- EOG）、肌肉活动（肌电图- EMG）和脑电波（脑电图- EEG）的数据，从而精确预测人类的情绪和反应。AR/VR头显的新可穿戴技术引入了一个多功能传感平台，可以实现用户和设备之间的双向神经通信。其柔软灵活的设计最大限度地减少了准确数据收集的运动，而碳基电极有助于保持高信噪比。同时，压电传感器检测手势和材料，动态增强用户交互。这一进步与耳机无缝集成，提供了一个具有成本效益，可扩展和防水的解决方案。从神经科学、材料科学和人工智能的角度出发，这种跨学科的方法扩展了可穿戴技术的可能性，有望在AR/VR环境中增强用户体验。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact of this I-Corps project is the development of next-generation extended reality technologies with integrated wearable biomedical sensors. The development of wearable technology for Augmented Reality/Virtual Reality (AR/VR) headsets has the potential to change how people use and embrace these technologies. By creating a controller platform that relies on user feedback, people can interact with devices that are more user-friendly. Additionally, the ability of these devices to detect materials can allow users to interact with virtual objects using natural hand gestures. By improving the understanding of and response to human actions, these devices will make the AR/VR experience more immersive and enjoyable. Overall, this advancement brings the users closer to seamlessly blending the real and virtual worlds, potentially making these technologies more accessible and beneficial.This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the development of a cost-effective, waterproof sensor made from carbon for Augmented Reality/Virtual Reality (AR/VR) headsets. This sensor will gather data on eye movements (electrooculography - EOG), muscle activity (electromyography - EMG), and brainwaves (electroencephalography - EEG), allowing for the precise prediction of human emotions and responses. The new wearable technology for AR/VR headsets introduces a versatile sensing platform to enable two-way neural communication between users and devices. Its soft, flexible design minimizes motion for accurate data collection, while carbon-based electrodes help maintain a high signal-to-noise ratio. Simultaneously, a piezoelectric sensor detects hand gestures and materials, dynamically enhancing user interaction. This advancement integrates seamlessly with headsets, offering a cost-effective, scalable, and waterproof solution. Drawing from neuroscience, materials science, and artificial intelligence, this interdisciplinary approach expands the possibilities of wearable technology, promising an enhanced user experiences in AR/VR environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.