NRI: INT: Collaborative Research: A Robotic Platform for Body-Scale Human Physical Interaction in Embodied Virtual Reality

NRI：INT：协作研究：实体虚拟现实中人体规模人体物理交互的机器人平台

• 批准号: 2024772
• 负责人: Kaveh Akbari Hamed
• 金额: $ 118.68万
• 依托单位: Virginia Polytechnic Institute and State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-10-01 至 2024-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2024772&HistoricalAwards=false
• 关键词: NRI; INT; Collaborative; Research; Robotic

This National Robotics Initiative project will contribute new knowledge at the convergence of several fields: virtual reality, robotic control, sensory feedback, ergonomics, and human factors. A customizable cobot will be designed to increase the fidelity of virtual reality simulations. The system will enable a user to feel the physical forces, movements, and constraints at both hands and both feet. By integrating a "whole-body" robotic system with a virtual reality platform, the PIs will advance the understanding of how robotics can be used to identify potential risks of human worker / robot collaborations, and for training towards reducing workplace risk exposures. The PIs will use modeling and simulation to evaluate and remove potential hazards to humans from collaborative robotic operations as well as to test collaborative robot and human interactions using simulated test beds. The effectiveness of the system will be evaluated via perceived presence, behavioral, and neurophysiological analysis. The project will advance the national prosperity by benefitting industry sectors that are likely to deploy collaborative robots (e.g., agriculture, construction, and healthcare). This project will benefit society by accelerating, through simulation, safety hazards that may arise when new technology is being designed, even before it gets deployed in the physical world. In addition, the PIs will engage a diverse pool of graduate and undergraduate students in the research. Project activities also include mentoring of high school students with disabilities to college and STEM training for first-generation elementary school students from rural areas through robotics summer camps. This project will design, build, control, and assess the effectiveness of a body-scale physical interaction simulation cobot in Virtual Reality that provides customizable force and position feedback at the hands and feet. The platform (named ForceBot) is a novel cobot designed to dramatically increase the fidelity of virtual reality simulations. This project will significantly contribute to the field of human-robot interaction by exploring how robot-based active haptic simulation can adapt to a variety of tasks, environments, and people, with minimal modification to hardware and software. Project effort is organized into three objectives: development of techniques for haptic rendering of simulated interactions using a VR physics engine; implementing and controlling the ForceBot system; and evaluating the integrated system in a series of human subject experiments. The project will advance knowledge of robot dynamics and algorithms for personalized human motion recognition and prediction. ForceBot will enable workers to receive training on future work, identifying potential risks of collaborative robots to workers, and evaluation of different control strategies for wearable robots like exoskeletons. If successful, this research will expand the potential for using virtual reality for training intensive physical tasks in multiple application domains including sports, gaming, emergency response, and industrial applications for reducing workplace risk exposures.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这个国家机器人计划项目将在几个领域的融合方面贡献新知识：虚拟现实、机器人控制、感官反馈、人体工程学和人为因素。将设计一个可定制的协作机器人，以提高虚拟现实模拟的保真度。该系统将使用户能够感受到双手和双脚的物理力量、运动和约束。通过将“全身”机器人系统与虚拟现实平台相结合，pi将促进对如何使用机器人技术识别人类工人/机器人合作的潜在风险的理解，并进行培训以减少工作场所的风险暴露。pi将使用建模和仿真来评估和消除协作机器人操作对人类的潜在危害，并使用模拟试验台测试协作机器人和人类的相互作用。该系统的有效性将通过感知存在、行为和神经生理分析来评估。该项目将使可能部署协作机器人的行业（如农业、建筑和医疗保健）受益，从而促进国家繁荣。这个项目将造福社会，通过模拟，加速新技术在设计过程中可能出现的安全隐患，甚至在它被部署到现实世界之前。此外，pi还将吸引各种各样的研究生和本科生参与研究。项目活动还包括指导高中残疾学生上大学，以及通过机器人夏令营为农村地区第一代小学生提供STEM培训。该项目将在虚拟现实中设计、构建、控制和评估一个身体尺度的物理交互模拟协作机器人的有效性，该协作机器人可以在手和脚上提供可定制的力和位置反馈。该平台（名为ForceBot）是一种新型协作机器人，旨在大幅提高虚拟现实模拟的保真度。该项目将通过探索基于机器人的主动触觉模拟如何适应各种任务，环境和人员，而对硬件和软件的修改最少，从而为人机交互领域做出重大贡献。项目工作分为三个目标：开发使用VR物理引擎模拟交互的触觉渲染技术；实现和控制ForceBot系统；并在一系列人体实验中对该综合系统进行了评价。该项目将推进机器人动力学知识和个性化人体运动识别和预测算法。ForceBot将使工人能够接受未来工作的培训，识别协作机器人对工人的潜在风险，并评估外骨骼等可穿戴机器人的不同控制策略。如果成功，这项研究将扩大在多个应用领域使用虚拟现实来训练密集的物理任务的潜力，包括体育、游戏、应急响应和工业应用，以减少工作场所的风险暴露。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Neurobehavioral assessment of force feedback simulation in industrial robotic teleoperation

• DOI: 10.1016/j.autcon.2021.103674
• 发表时间: 2021-06
• 期刊: Automation in Construction
• 影响因子: 10.3
• 作者: Qi Zhu;Jing Du;Yangming Shi;P. Wei

Sensitivity of Eye-Tracking Measures to Variations in Mental Workload while Learning to Operate a Physically Coupled Robot

学习操作物理耦合机器人时眼动追踪测量对脑力负荷变化的敏感性

• 发表时间: 2022
• 期刊: Proceedings of the Human Factors and Ergonomics Society Annual Meeting
• 作者: Satyajit Upasani;Qi Zhu;E. Du;A. Leonessa;D. Srinivasan
• 通讯作者: D. Srinivasan