Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System

交互式自主机器人系统中视觉感知和操纵的研究与开发

基本信息

  • 批准号:
    RGPIN-2017-05762
  • 负责人:
  • 金额:
    $ 1.53万
  • 依托单位:
  • 依托单位国家:
    加拿大
  • 项目类别:
    Discovery Grants Program - Individual
  • 财政年份:
    2022
  • 资助国家:
    加拿大
  • 起止时间:
    2022-01-01 至 2023-12-31
  • 项目状态:
    已结题

项目摘要

The proposed proposal for the program is to develop methodologies and technologies that will lead to precise manipulation of autonomous mobile robots in practical applications with dynamic interaction. The main contribution is set to improve the versatility, autonomy and dependability of current autonomous robotic systems, specifically in manipulation applications. In view of the needed capabilities for the ultimate objective, the scope of the proposed program spans four main research areas: 1. Machine vision, specifically real-time and robust object tracking and hand gesture understanding 2. Advanced force, tactile and vision control, 3. Machine learning, and 4. Sensor fusion. An overall architecture is proposed, containing three sub-systems: 1). Efficient visual tracking and motion estimation; 2). Interaction framework; and 3). Advanced control in manipulation. In the proposed architecture, the efficient visual tracking provides real-time and robust object tracking and motion estimation results to the vision-based control. The proposed interaction framework contains a knowledge base that describes tasks, and a high-level interpreter that can provide references for pose, force and tactile information in a given task. Also, an advanced control system will be developed, which will achieve the alignment of hand with respect to the object according to the suggested pose by the high-level task interpreter, and a position-force-tactile controller to provide robust and stable manipulation during the contact. The proposed program will lead to innovative interaction framework for an autonomous robotic system in manipulation, efficient optical tracking in motion and motion estimation, and human-like-manipulation by developing an advanced position-force-tactile controller with an interaction framework. The research results in the proposed program will have significant potential for application in many practical areas including search and rescue, homecare and assistive robots. The developed intelligent autonomous robots are applicable in industry and in daily life, leading to improved work efficiency, reduced workload for humans, and effective execution of tasks that require heavy duty machinery. The developed technologies are expected to result in significant progress in robotics research, particularly concerning perception, interaction and manipulation, and provide new research directions in autonomous robotics.
该计划的建议是开发方法和技术,将导致在动态交互的实际应用中精确操纵自主移动机器人。主要贡献是提高当前自主机器人系统的多功能性、自主性和可靠性,特别是在操纵应用中。考虑到最终目标所需的能力,拟议计划的范围涵盖四个主要研究领域:1。机器视觉,特别是实时和鲁棒的对象跟踪和手势理解先进的力量,触觉和视觉控制,2。4.机器学习。传感器融合。提出了一个整体体系结构,包括三个子系统:1)。高效的视觉跟踪和运动估计;2). 交互框架;和3)。先进的操纵控制。在该体系结构中,高效的视觉跟踪为基于视觉的控制提供了实时、鲁棒的目标跟踪和运动估计结果。所提出的交互框架包含一个描述任务的知识库和一个高级解释器,该解释器可以为给定任务中的姿势、力度和触觉信息提供参考。此外,将开发一种先进的控制系统,该系统将根据高级任务解释器建议的姿势实现手与物体的对齐,以及一个位置-力-触觉控制器,在接触过程中提供鲁棒和稳定的操作。该计划将通过开发具有交互框架的先进位置-力-触觉控制器,为自主机器人系统的操作,运动和运动估计的有效光学跟踪以及类人操作提供创新的交互框架。本课题的研究成果将在包括搜救、家庭护理和辅助机器人在内的许多实际领域具有重要的应用潜力。开发的智能自主机器人适用于工业和日常生活,提高了工作效率,减少了人类的工作量,并有效地执行需要重型机械的任务。这些发展起来的技术有望在机器人研究方面取得重大进展,特别是在感知、交互和操纵方面,并为自主机器人研究提供新的方向。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Lang, Haoxiang其他文献

Quantifying drivers' driving skills using closed-loop dynamic simulations of articulated heavy vehicles
  • DOI:
    10.1016/j.simpat.2019.102014
  • 发表时间:
    2020-02-01
  • 期刊:
  • 影响因子:
    4.2
  • 作者:
    Brown, Jesse;He, Yuping;Lang, Haoxiang
  • 通讯作者:
    Lang, Haoxiang
A Hybrid Visual Servo Controller for Robust Grasping by Wheeled Mobile Robots
用于轮式移动机器人稳健抓取的混合视觉伺服控制器
  • DOI:
    10.1109/tmech.2009.2034740
  • 发表时间:
    2010-10-01
  • 期刊:
  • 影响因子:
    6.4
  • 作者:
    Wang, Ying;Lang, Haoxiang;de Silva, Clarence W.
  • 通讯作者:
    de Silva, Clarence W.
Energy and exergy analyses of a biogas driven multigenerational system
  • DOI:
    10.1016/j.energy.2018.10.085
  • 发表时间:
    2019-01-01
  • 期刊:
  • 影响因子:
    9
  • 作者:
    Sevinchan, Eren;Dincer, Ibrahim;Lang, Haoxiang
  • 通讯作者:
    Lang, Haoxiang
A Neural Network Based Method for Thermal Fault Detection in Lithium-Ion Batteries
基于神经网络的锂离子电池热故障检测方法

Lang, Haoxiang的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Lang, Haoxiang', 18)}}的其他基金

Design optimization and development of a MRI enabled autonomous surgical robotic system
MRI 驱动的自主手术机器人系统的设计优化和开发
  • 批准号:
    568551-2021
  • 财政年份:
    2021
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Alliance Grants
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2021
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2020
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2019
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Design and Development of a Real-time Multi-object Detection and Tracking Vision System for MP-R Patrol Robot**********
MP-R巡逻机器人实时多目标检测与跟踪视觉系统的设计与开发************
  • 批准号:
    536008-2018
  • 财政年份:
    2018
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Engage Grants Program
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2018
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2017
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual

相似国自然基金

水稻边界发育缺陷突变体abnormal boundary development(abd)的基因克隆与功能分析
  • 批准号:
    32070202
  • 批准年份:
    2020
  • 资助金额:
    58 万元
  • 项目类别:
    面上项目
Development of a Linear Stochastic Model for Wind Field Reconstruction from Limited Measurement Data
  • 批准号:
  • 批准年份:
    2020
  • 资助金额:
    40 万元
  • 项目类别:

相似海外基金

Research development of a human-centered intelligent robot system based on the fusion of advanced artificial intelligent technologies of tactile-visual sensing and control strategy
基于触觉视觉传感与控制策略的先进人工智能技术融合的以人为中心的智能机器人系统的研究开发
  • 批准号:
    23K03790
  • 财政年份:
    2023
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Grant-in-Aid for Scientific Research (C)
The research on relationships between development of visual processing and developmental risks in late premature birth
晚期早产视觉处理发育与发育风险关系的研究
  • 批准号:
    23H01055
  • 财政年份:
    2023
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Excellence in Research: Human Visual Perception of Changes in Smoke and Flame Cues during Early Fire Development
卓越的研究:早期火灾发展过程中烟雾和火焰线索变化的人类视觉感知
  • 批准号:
    2200416
  • 财政年份:
    2022
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Standard Grant
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2021
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2020
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Development of a visual dialogue program for collaborative research
开发用于协作研究的视觉对话程序
  • 批准号:
    19K20622
  • 财政年份:
    2019
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2019
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
Pathological research focusing on optic nerve papillary capillaries for the development of treatment for severe glaucoma with reduced visual acuity
以视神经乳头毛细血管为重点的病理学研究,用于开发视力下降的严重青光眼的治疗方法
  • 批准号:
    19K18868
  • 财政年份:
    2019
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
Research on development of technologies to reduce the barrier of visual information for aimed to assist learning of visually impaired students
减少视觉信息障碍的技术开发研究,旨在帮助视障学生学习
  • 批准号:
    18H01058
  • 财政年份:
    2018
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Grant-in-Aid for Scientific Research (B)
Research and Development of Visual Perception and Manipulation in an Interactive Autonomous Robotic System
交互式自主机器人系统中视觉感知和操纵的研究与开发
  • 批准号:
    RGPIN-2017-05762
  • 财政年份:
    2018
  • 资助金额:
    $ 1.53万
  • 项目类别:
    Discovery Grants Program - Individual
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了