I-Corps: Translation Potential of Bidirectional Neural Communication for Extended Reality Technologies

I-Corps：双向神经通信在扩展现实技术中的转化潜力

• 批准号: 2419142
• 负责人: Huanyu Cheng
• 金额: $ 5万
• 依托单位: Pennsylvania State Univ University Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-04-01 至 2025-03-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2419142&HistoricalAwards=false
• 关键词: Corps; Translation; Potential; Bidirectional; Neural

The broader impact of this I-Corps project is the development of next-generation extended reality technologies with integrated wearable biomedical sensors. The development of wearable technology for Augmented Reality/Virtual Reality (AR/VR) headsets has the potential to change how people use and embrace these technologies. By creating a controller platform that relies on user feedback, people can interact with devices that are more user-friendly. Additionally, the ability of these devices to detect materials can allow users to interact with virtual objects using natural hand gestures. By improving the understanding of and response to human actions, these devices will make the AR/VR experience more immersive and enjoyable. Overall, this advancement brings the users closer to seamlessly blending the real and virtual worlds, potentially making these technologies more accessible and beneficial.This I-Corps project utilizes experiential learning coupled with a first-hand investigation of the industry ecosystem to assess the translation potential of the technology. The solution is based on the development of a cost-effective, waterproof sensor made from carbon for Augmented Reality/Virtual Reality (AR/VR) headsets. This sensor will gather data on eye movements (electrooculography - EOG), muscle activity (electromyography - EMG), and brainwaves (electroencephalography - EEG), allowing for the precise prediction of human emotions and responses. The new wearable technology for AR/VR headsets introduces a versatile sensing platform to enable two-way neural communication between users and devices. Its soft, flexible design minimizes motion for accurate data collection, while carbon-based electrodes help maintain a high signal-to-noise ratio. Simultaneously, a piezoelectric sensor detects hand gestures and materials, dynamically enhancing user interaction. This advancement integrates seamlessly with headsets, offering a cost-effective, scalable, and waterproof solution. Drawing from neuroscience, materials science, and artificial intelligence, this interdisciplinary approach expands the possibilities of wearable technology, promising an enhanced user experiences in AR/VR environments.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

I-Corps项目的更广泛影响是开发集成可穿戴生物医学传感器的下一代延展实境技术。增强现实/虚拟现实（AR/VR）头显的可穿戴技术的发展有可能改变人们使用和接受这些技术的方式。通过创建一个依赖于用户反馈的控制器平台，人们可以与用户更友好的设备进行交互。此外，这些设备检测材料的能力可以允许用户使用自然手势与虚拟对象进行交互。通过改善对人类行为的理解和响应，这些设备将使AR/VR体验更加身临其境和令人愉快。总的来说，这一进步使用户更接近于无缝融合真实的和虚拟世界，可能使这些技术更容易获得和有益。这个I-Corps项目利用体验式学习加上对行业生态系统的第一手调查来评估该技术的翻译潜力。该解决方案基于开发一种用于增强现实/虚拟现实（AR/VR）头戴式设备的碳纤维防水传感器。该传感器将收集有关眼球运动（眼电图- EOG），肌肉活动（肌电图- EMG）和脑电波（脑电图- EEG）的数据，从而精确预测人类的情绪和反应。AR/VR头显的新可穿戴技术引入了一个多功能传感平台，以实现用户和设备之间的双向神经通信。其柔软、灵活的设计可最大限度地减少运动，以实现准确的数据收集，而碳基电极有助于保持高信噪比。同时，压电传感器检测手势和材料，动态增强用户交互。这一进步与耳机无缝集成，提供了一个具有成本效益的，可扩展的，防水的解决方案。这项跨学科的研究方法从神经科学、材料科学和人工智能等领域汲取了灵感，拓展了可穿戴技术的可能性，有望增强AR/VR环境中的用户体验。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。