NRI: Collaborative Research: Software Framework for Research in Semi-Autonomous Teleoperation

NRI：协作研究：半自主远程操作研究的软件框架

• 批准号: 1637789
• 负责人: Peter Kazanzides
• 金额: $ 96.98万
• 依托单位: Johns Hopkins University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2020-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1637789&HistoricalAwards=false
• 关键词: NRI; Collaborative; Research; Software; Framework

Telemanipulation systems consist of a human interacting with a mechanical device on the master side to operate a robot at the remote side. They provide natural opportunities for research in intelligent human/robot collaboration, but existing commercial systems, used in areas such as telesurgery, are not intelligent and therefore only replicate the actions of the human operator. These systems are also proprietary, expensive, and not available for modification by researchers. The goal of this NRI project is to provide an open-source software infrastructure that is designed to work with a broad range of hardware and simulated devices to enable a larger community to pursue research and education in intelligent telemanipulation at a lower cost.The increasing pace of robotics research can be attributed, at least in part, to the increasing availability of software infrastructure, such as Robot Operating System (ROS), and open hardware platforms. This NRI project focuses on providing a software infrastructure for research in intelligent telemanipulation, leveraging infrastructure developed for the Raven II robot and the da Vinci Research Kit (dVRK) and continuing to extend it to other systems, including simulated robots. The three main tasks are to: (1) engage the community to guide development, (2) develop and implement a common API for the diverse hardware platforms, and (3) provide a set of high-level, platform-independent software modules. The goal is to support research towards semi-autonomous telerobotic systems that can more effectively combine the knowledge, reasoning, and decision-making capabilities of a human with the sensing and manipulation capabilities of a robot.

远程操控系统包括人类与主控端的机械设备交互，以操作远程端的机器人。它们为智能人类/机器人协作的研究提供了自然的机会，但用于远程外科等领域的现有商业系统并不智能，因此只能复制人类操作员的行动。这些系统也是专有的，价格昂贵，研究人员无法对其进行修改。该NRI项目的目标是提供一个开源软件基础设施，旨在与广泛的硬件和模拟设备一起工作，使更大的社区能够以更低的成本从事智能远程操控方面的研究和教育。机器人研究的速度不断加快，至少部分可以归因于软件基础设施的日益可用，如机器人操作系统(ROS)和开放硬件平台。该NRI项目专注于为智能遥控操控研究提供软件基础设施，利用为Raven II机器人和达芬奇研究套件(DVRK)开发的基础设施，并继续将其扩展到其他系统，包括模拟机器人。三项主要任务是：(1)让社区参与指导开发，(2)为不同的硬件平台开发和实现通用API，以及(3)提供一套高级别的、独立于平台的软件模块。其目标是支持对半自动遥控机器人系统的研究，这种系统可以更有效地将人类的知识、推理和决策能力与机器人的感知和操作能力结合起来。

项目成果

A Computational Framework for Complementary Situational Awareness (CSA) in Surgical Assistant Robots

手术辅助机器人中的补充态势感知 (CSA) 计算框架

• DOI: 10.1109/irc.2018.00011
• 发表时间: 2018
• 期刊: 2018 IEEE International Conference on Robotic Computing (IRC
• 作者: Chalasani, Preetham;Deguet, Anton;Kazanzides, Peter;Taylor, Russell H.
• 通讯作者: Taylor, Russell H.

A Unified Framework for the Teleoperation of Surgical Robots in Constrained Workspaces

• DOI: 10.1109/icra.2019.8794363
• 发表时间: 2018-09
• 期刊: 2019 International Conference on Robotics and Automation (ICRA)
• 作者: M. M. Marinho-M.;Bruno Vilhena Adorno;K. Harada;Kyoichi Deie;A. Deguet;P. Kazanzides;R. Taylor;M. Mitsuishi

dVRK-XR: Mixed Reality Extension for da Vinci Research Kit

dVRK-XR：达芬奇研究套件的混合现实扩展

• 发表时间: 2019
• 期刊: Hamlyn Symposium on Medical Robotics
• 作者: Qian, Long;Deguet, Anton;Kazanzides, Peter
• 通讯作者: Kazanzides, Peter

Scene Modeling and Augmented Virtuality Interface for Telerobotic Satellite Servicing

用于远程机器人卫星服务的场景建模和增强虚拟接口

• DOI: 10.1109/lra.2018.2864358
• 发表时间: 2018
• 期刊: IEEE Robotics and Automation Letters
• 影响因子: 5.2
• 作者: Vagvolgyi, Balazs P.;Pryor, Will;Reedy, Ryan;Niu, Wenlong;Deguet, Anton;Whitcomb, Louis L.;Leonard, Simon;Kazanzides, Peter
• 通讯作者: Kazanzides, Peter

Collaborative Robotics Toolkit (CRTK): Open Software Framework for Surgical Robotics Research

协作机器人工具包 (CRTK)：用于手术机器人研究的开放软件框架

• DOI: 10.1109/irc.2020.00014
• 发表时间: 2020
• 期刊: 2020 Fourth IEEE International Conference on Robotic Computing (IRC
• 作者: Su, Yun-Hsuan;Munawar, Adnan;Deguet, Anton;Lewis, Andrew;Lindgren, Kyle;Li, Yangming;Taylor, Russell H.;Fischer, Gregory S.;Hannaford, Blake;Kazanzides, Peter
• 通讯作者: Kazanzides, Peter