CI-P: Planning for SMART-MOVE: A Spatiotemporal Annotated Human Activity Repository for Advanced Motion Recognition and Analysis Research

精确的人体运动跟踪和活动识别对于支持计算机科学和工程研究的许多领域非常重要，从用户建模和人机交互到图形和动画。一个良好的注释数据集和注释工具资源在涉及人体限制、慢性残疾人（如中风后、ALS、风湿性关节炎、脑瘫等）的研究中尤为重要。目前，还没有一个具有人类活动数据和分析工具的综合社区CRI。开发新的方法和算法，以改善和实现现实世界的运动跟踪应用是由一个固有的困难：缺乏大量的训练和测试数据集的阻碍。这项规划活动汇集了计算机视觉，机器学习，数据挖掘，用户界面设计，辅助环境，人机交互，数据库研究，涉及真实的时间人类活动的大数据，治疗师，临床医生，设备制造商和传感器开发人员，以便在构建自动和准确注释的视频存储库时识别应收集和处理的特定人类活动数据具体地，自动且准确地注释的人类运动的视频数据的储存库具有通过显著提高识别用于评估环境、药物、人类心理的汇合的行为标记的能力来影响使用人类运动跟踪和识别的若干学科的研究的潜力，并且因此扩展临床和心理领域。然而，由于大数据问题（体积，速度，多样性，准确性，由人类行为的多感官视觉输入引起），自动化数据收集，特别是注释的任务是不平凡的。传统上，人体运动的视频数据是人工采集和注释的。由于视频传感器产生的数据量很大，因此这项任务非常繁琐且容易出错。出于这个原因，大多数现有的数据集都非常小，并且专门针对收集它们的问题。该项目将收集研究用户社区关于如何最好地开发这样一个人类活动CRI储存库的投入。 将组织一次讲习班，邀请专家帮助确定应收集和处理的具体人类活动数据。讲习班期间征求的意见将有助于确定拟议的智能移动储存库的特点和设施，这是一个时空注释的人体运动储存库，侧重于以下方面：（1）确定要捕捉的具体活动和多传感器数据收集方法;（2）准确实时注释和存储所收集数据的工具;（3）搜索工具，使研究人员能够贡献和提供反馈;（4）事件识别和数据摘要工具，使研究人员能够自动分析自己的新大数据;（5）拟议的数据收集和分析是否可行，使用一组战略性选择的多流数据，以保持整个项目的低成本;（6）当对由不同传感器或不同采样频率收集的异构类型的人类活动数据进行建模时的限制。

Accurate human motion tracking and activity recognition are important in supporting numerous areas of computer science and engineering research, ranging from user modeling and human robot interaction to graphics and animation. A good resource of annotated datasets and annotation tools is particularly important in research involving physical human limitations, persons with chronic disabilities, such as post-stroke, ALS, Rheumatoid Arthritis, Cerebral Palsy, and others. Currently, a comprehensive community CRI with human activity data and analysis tools is not in place. The development of new methods and algorithms that will improve and enable real-world motion tracking applications is hampered by an inherent difficulty: the lack of large sets of training and testing data. This planning activity brings together experts in computer vision, machine learning, data mining, user interface design, assistive environments, human robot interaction, databases research, big data involving real time human activity, therapists, clinicians, device makers and sensor developers in order to identify the specific human activity data that should be collected and processed when building a repository of automatically and accurately annotated video data of human motion.Specifically, a repository of automatically and accurately annotated video data of human motion has the potential to impact the research of several disciplines using human motion tracking and recognition by significantly improving the ability to recognize behavioral markers for assessing the confluence of environment, drugs, human psychology and thus extend clinical and psychological areas. However, due to big data issues (volume, velocity, variety, veracity, arising from multisensory visual input of human behavior), the tasks of automating data collection and especially annotation are non-trivial. Traditionally, video data of human motion are collected and annotated manually. Due to the large amount of data generated by video sensors, this task is very tedious and error prone. For this reason, most existing datasets are very small and specialized to the problem for which they were collected. This project will gather input from the research user communities on how to best develop such a CRI repository of human activity. A workshop will be organized with invited experts who will help identify the specific human activity data that should be collected and processed. The input solicited during the workshop will help define the features and facilities of the proposed Smart-Move repository, a spatiotemporal annotated human motion repository by focusing on the following: (1) determining the specific activities to be captured and the methods of multisensory data collection; (2) tools for accurate real-time annotation and storage of the collected data; (3) search facilities to enable researchers to contribute and provide feedback; (4) event recognition and data summarization tools to enable researchers to analyze their own new big data automatically; (5) feasibility of the proposed data collection and analysis using a strategically chosen set of multi-stream data to keep the overall project cost low; (6) limitations when modeling heterogeneous types of human activity data collected by different sensors or of different sample frequencies.