NeTS-NOSS: Collaborative Research: The BehaviorScope Project: Sensory Grammars for Sensor Networks

BehaviorScope项目旨在开发一个框架，用于从分布式多模态传感器节点中的传感器数据和元数据中理解模式和行为。模式和行为（尤其是人类的）将被概率语法和其他机制的层次结构解析为紧凑的、更具描述性的语义形式。这些更高层次的数据解释将提供必要的网络认知，以在许多日常生活应用中提供服务，如辅助生活、工作场所安全、安保、娱乐等。该项目将使用轻型相机传感器网络作为主要平台，并将重点放在两种类型的时空数据处理上。在局部传感器的视野中，本研究将研究滤波器的设计，以鲁棒地检测人类及其手势和姿势。在更宏观的层面上，传感器的集合将协调以检测长期的行为模式。预期的结果是一个新的数据解释框架，可以理解数据的空间和时间方面，并以有意义的服务对它们作出响应。为了收集真实的数据，并在实际应用中展示已开发的概念，本工作将以辅助生活为驱动应用。在此背景下，开发的传感器网络将对独居老人的行为进行监督，生成日常活动摘要，在老人从事危险活动时发出警告和警报，并提供各种服务，增加老年人的自主性和独立性。

The BehaviorScope project seeks to develop a framework for understanding patterns and behaviors from sensor data and metadata in distributed multimodal sensor nodes. Patterns and behaviors (especially of humans) will be parsed by a hierarchy of probabilistic grammars and other mechanisms into a compact and more descriptive semantic form. These higher-level interpretations of the data will provide the necessary network cognition needed to provide services in many everyday life applications such as assisted living, workplace safety, security, entertainment and more. The project will use a lightweight camera sensor network as its primary platform and will focus on two types of spatio-temporal data processing. At the local sensor's field of view, this research will investigate the design of filters for robustly detecting humans as well as their gestures and postures. At a more macroscopic level, collections of sensors will coordinate to detect longer term patterns of behavior. The expected outcome is a new data interpretation framework that can understand the spatial and temporal aspects of data and respond to them with meaningful services. To collect real data and to demonstrate the developed concepts in practical applications, this work will use assisted living as the driver application. In this context, the developed sensor network will supervise the behaviors of elders living alone at home to generate daily activity summaries, post warnings and alarms when they engage in dangerous activities, and provide a variety of services that increase the autonomy and independence of these individuals.