CPS: Synergy: Collaborative Research: SensEye: An Architecture for Ubiquitous, Real-Time Visual Context Sensing and Inference

CPS：协同：协作研究：SensEye：无处不在的实时视觉上下文感知和推理架构

• 批准号: 1239031
• 负责人: Prabal Dutta
• 金额: $ 30万
• 依托单位: Regents of the University of Michigan - Ann Arbor
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-10-01 至 2016-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1239031&HistoricalAwards=false
• 关键词: CPS; Synergy; Collaborative; Research; SensEye

Continuous real-time tracking of the eye and field-of-view of an individual is profoundly important to understanding how humans perceive and interact with the physical world. This work advances both the technology and engineering of cyber-physical systems by designing an innovative paradigm involving next-generation computational eyeglasses that interact with a user's mobile phone to provide the capability for real-time visual context sensing and inference. This research integrates novel research into low-power embedded systems, image representation, image processing and machine learning, and mobile sensing and inference, to advance the state-of-art in continuous sensing for CPS applications. The activity addresses several fundamental research challenges including: 1) design of novel, highly integrated, computational eyeglasses for tracking eye movements, the visual field of a user, and head movement patterns, all in real-time; 2) a unified compressive signal processing framework that optimizes sensing and estimation, while enabling re-targeting of the device to perform a broad range of tasks depending on the needs of an application; 3) design of a novel real-time visual context sensing system that extracts high-level contexts of interest from compressed data representations; and 4) a layer of intelligence that combines contexts extracted from the computational eyeglass together with contexts obtained from the mobile phone to improve energy-efficiency and sensing accuracy.This technology can revolutionize a range of disciplines including transportation, healthcare, behavioral science and market research. Continuous monitoring of the eye and field-of-view of an individual can enable detection of hazardous behaviors such as drowsiness while driving, mental health issues such as schizophrenia, addictive behavior and substance abuse, neurological disease progression, head injuries, and others. The research provides the foundations for such applications through the design of a prototype platform together with real-time sensor processing algorithms, and making these systems available through open source venues for broader use. Outreach for this project includes demonstrations of the device at science fairs for high-school students, and integration of the platform into undergraduate and graduate courses.

持续实时跟踪一个人的眼睛和视野对于理解人类如何感知和与物理世界互动非常重要。这项工作通过设计一种涉及下一代计算眼镜的创新范例，推进了网络物理系统的技术和工程，该眼镜与用户的移动电话交互，提供实时视觉上下文感知和推理的能力。本研究将新研究整合到低功耗嵌入式系统，图像表示，图像处理和机器学习，以及移动传感和推理中，以推进CPS应用中连续传感的最新技术。该活动解决了几个基础研究挑战，包括：1)设计新颖、高度集成的计算眼镜，用于实时跟踪眼球运动、用户的视野和头部运动模式；2)统一的压缩信号处理框架，优化传感和估计，同时根据应用的需要重新定位设备以执行广泛的任务；3)设计一种新的实时视觉上下文感知系统，从压缩数据表示中提取高级感兴趣的上下文；4)一层智能，将从计算眼镜中提取的上下文与从手机中获得的上下文相结合，以提高能效和传感精度。这项技术可以彻底改变一系列学科，包括交通运输、医疗保健、行为科学和市场研究。持续监测一个人的眼睛和视野可以检测危险行为，如开车时的困倦、精神分裂症等精神健康问题、成瘾行为和药物滥用、神经系统疾病进展、头部损伤等。该研究通过设计原型平台以及实时传感器处理算法，为此类应用提供了基础，并使这些系统通过开源场所获得更广泛的使用。该项目的推广包括在高中生科学博览会上展示该设备，并将该平台整合到本科和研究生课程中。