Collaborative Research: NRI: INT: Transparent and Intuitive Teleoperation Interfaces for the Future Nursing Robots and Workers

合作研究：NRI：INT：未来护理机器人和工人的透明直观的远程操作界面

• 批准号: 2024802
• 负责人: Zhi Li
• 金额: $ 73.13万
• 依托单位: Worcester Polytechnic Institute
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-09-01 至 2024-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2024802&HistoricalAwards=false
• 关键词: Collaborative; Research; NRI; INT; Transparent

The recent pandemic outbreaks, including Ebola, Zika and the 2019 Novel Coronavirus (2019-nCoV), urge tele-medicine to go beyond mere tele-presence, to achieve robots that perform real-world nursing assistance tasks that require the coordinated control of manipulation, locomotion, and active teleoperation. Remotely-controlled nursing robots provide a promising alternative for quarantine and remote patient care. However, the traditional and contemporary human-robot interfaces fundamentally limit the performance and user experience of nursing robot teleoperation, and may reinforce burden and safety concerns that discourage healthcare workers to adopt robots. To address this problem, this project will (1) develop an innovative integration of transparent and intuitive teleoperation interface, to support the freeform and coordinated motion control of the remote nursing robots, and (2) integrate this interface with the robot intelligence to enable nursing professionals to learn robot teleoperation with minimal training, and to reduce the physical and cognitive workload using shared autonomy. The proposed project will promote the progress of science in human-robot interfaces for robot teleoperation, and advance the quality, availability and sustainability of healthcare in the present and future pandemic crisis. This project will have significant impacts on the domain of nursing, which consists of 2.9 million registered nurses and 160,000 nurse practitioners across the U.S. It will revolutionize patient-care in quarantine, and has the potential to extend to in-home care, clinics, and hospitals given the upcoming shortage of nursing workforce. The fundamental research also generalizes to other worker domains with robot tele-operations, including warehouse, social service, and maintenance. The proposed research will forge substantial collaboration among faculty and students in robotics engineering, nursing and social science. This project consists of two research themes. Research Theme 1 will develop a soft-robot teleoperation interface architecture and systematic human-inspired motion mapping strategies, to support the intuitive and transparent mapping of the motion, force, and perception information between humans and robots. The proposed interface will enable transparent and legible robot behavior of reaching-to-grasp, loco-manipulation, and the control of active telepresence. Research Theme 2 will develop the intelligence of the interface, to enable interactive learning and mutual adaptation between humans and robots. Based on game-theoretic planning, it will develop adaptive shared autonomous strategies that use human-robot communication via haptic feedback. It will employ active tele-presence to enhance the training and reduce workload in tele-operation of the human operator. The integrated interface will be evaluated in comprehensive user studies with registered nurses, nursing faculty and nursing students. The evaluation will assess the performance and user experience, including human-robot teaming, using efficiency, workload and interface effort metrics. It will also evaluate the social impacts of the proposed human-robot interface on the acceptance and adoption of nursing robots by the current and future nursing workforce. This proposal was funded with the National Institute for Occupational Safety and Health (NIOSH) in the Center for Disease Control and Prevention (CDC).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

最近的大流行病爆发，包括埃博拉病毒，寨卡病毒和2019年新型冠状病毒（2019-nCoV），敦促远程医疗超越单纯的远程存在，实现机器人执行现实世界的护理援助任务，需要协调控制操纵，运动和主动远程操作。远程控制的护理机器人为隔离和远程病人护理提供了一种有前途的选择。然而，传统的和当代的人机界面从根本上限制了护理机器人遥操作的性能和用户体验，并可能加剧负担和安全问题，阻碍医护人员采用机器人。为了解决这个问题，本项目将（1）开发一个透明和直观的遥操作界面的创新集成，以支持远程护理机器人的自由形式和协调运动控制，以及（2）将此界面与机器人智能集成，使护理专业人员能够以最少的培训学习机器人遥操作，并使用共享自治来减少物理和认知工作量。建议的项目将促进机器人远程操作人机界面的科学进步，并在当前和未来的疫情危机中提高医疗保健的质量、可用性和可持续性。该项目将对护理领域产生重大影响，该领域由全美290万注册护士和16万护士执业者组成，它将彻底改变隔离中的病人护理，并有可能扩展到家庭护理，诊所和医院，因为即将到来的护理劳动力短缺。基础研究也推广到其他工人领域的机器人远程操作，包括仓库，社会服务和维护。拟议中的研究将在机器人工程、护理和社会科学领域的师生之间建立实质性的合作。该项目包括两个研究主题。研究主题1将开发一个软机器人遥操作接口架构和系统的人类启发的运动映射策略，以支持人类和机器人之间的运动，力和感知信息的直观和透明的映射。建议的接口将使透明和清晰的机器人行为达到把握，本地操作，并控制主动遥现。研究主题2将开发界面的智能，以实现人类和机器人之间的互动学习和相互适应。基于博弈论规划，它将开发自适应共享自主策略，通过触觉反馈使用人机通信。它将采用主动远程呈现，以加强培训，减少操作人员远程操作的工作量。综合界面将在全面的用户研究与注册护士，护理教师和护理学生进行评估。评估将使用效率、工作负载和界面工作量指标评估性能和用户体验，包括人机合作。它还将评估拟议的人机界面对当前和未来护理人员接受和采用护理机器人的社会影响。该提案由美国疾病控制与预防中心（CDC）的国家职业安全与健康研究所（NIOSH）资助。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

How People Use Active Telepresence Cameras in Tele-manipulation

人们如何使用主动远程呈现摄像机进行远程操作

• DOI: 10.1109/icra48506.2021.9561243
• 发表时间: 2021
• 期刊: 2021 IEEE International Conference on Robotics and Automation (ICRA
• 作者: Lin, Tsung-Chi;Krishnan, Achyuthan Unni;Li, Zhi
• 通讯作者: Li, Zhi

Probabilistic Planning with Partially Ordered Preferences over Temporal Goals

• DOI: 10.1109/icra48891.2023.10160678
• 发表时间: 2022-09
• 期刊: 2023 IEEE International Conference on Robotics and Automation (ICRA)
• 作者: Hazhar Rahmani;A. Kulkarni;Jie Fu

Fabric-Silicone Composite Haptic Muscles for Sensitive Wearable Force Feedback

用于敏感可穿戴力反馈的织物-硅胶复合触觉肌肉

• DOI: 10.1145/3594806.3594853
• 发表时间: 2023
• 期刊: Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments
• 作者: Rameshwar, Raagini;Skorina, Erik Howard;Onal, Cagdas D
• 通讯作者: Onal, Cagdas D

Design Interface Mapping for Efficient Free-form Tele-manipulation

• DOI: 10.1109/iros47612.2022.9982149
• 发表时间: 2022-10
• 期刊: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
• 作者: Achyuthan Unni Krishnan;Tsung-Chi Lin;Zhi Li

Active Telepresence Assistance for Supervisory Control: A User Study with a Multi-Camera Tele-Nursing Robot

用于监控的主动远程呈现辅助：多摄像头远程护理机器人的用户研究

• DOI: 10.1109/icra48506.2021.9561361
• 发表时间: 2021
• 期刊: 2021 IEEE International Conference on Robotics and Automation (ICRA
• 作者: Valiton, Alexandra;Baez, Hannah;Harrison, Naomi;Roy, Justine;Li, Zhi
• 通讯作者: Li, Zhi