Collaborative Research: HCC: Small: Leveraging a Wrapped Haptic Display to Communicate Robot Learning and Accelerate Human Teaching

合作研究:HCC:小型:利用包裹式触觉显示器来传达机器人学习并加速人类教学

基本信息

  • 批准号:
    2129155
  • 负责人:
  • 金额:
    $ 24.95万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Standard Grant
  • 财政年份:
    2021
  • 资助国家:
    美国
  • 起止时间:
    2021-10-01 至 2024-09-30
  • 项目状态:
    已结题

项目摘要

Humans excel at teaching physical activities and tasks through demonstration and physical correction (think of a coach guiding an athlete through a desired motion), and human learners often use verbal and nonverbal signals to communicate their understanding or confusion. Similar approaches to teaching have been used between humans and robots, allowing humans to naturally demonstrate tasks, like cooking or furniture assembly, and correct errors in the motions of the robots. While robots have made great advances in understanding the demonstrations and corrections from human teachers, they have lacked an effective way to communicate what they do and do not understand, so human teachers may not know when or if a robot is ready to carry out a task by itself. This project will address this communication gap by developing new ways for robot arms to communicate to human teachers as they learn. The investigators will attach haptic skin displays (arrays of controllable bubbles) to a robotic arm and create touch sensations to communicate the robot’s understanding or confusion to the human teacher. Better and more understandable communication from robots as they learn will allow users to train or retrain robots more efficiently, and to better know when they are ready to deploy, without needing specialized knowledge about how robots function. These features will make robot arms more attractive tools for small and mid-sized manufacturers, allowing them to flexibly automate some manufacturing tasks. The lessons learned about communicating the learning state of robotic arms can also be applied to other computer and robotic systems, making the opaque process of robot and computer learning more comprehensible and giving the opportunity to catch and correct errors.The goal of this project is to characterize how humans perceive haptic skin displays wrapped around robot arms, and to formalize how robots capture and communicate feedback through these haptic arrays. Prior work enables robots to learn from physical demonstrations; however, it is equally important to make this learning transparent to the human teacher. This project will advance transparent and interpretable robot learning from an algorithmic and haptic perspective. The team of investigators will i) characterize the types and patterns of exploratory haptic feedback the human perceives, ii) embed the robot's complex and high-dimensional reward learning into low-dimensional haptic feedback, and iii) model how humans interpret the robot's feedback. These steps will ultimately provide human teachers with an awareness of the robot’s understanding and thereby improve their demonstrations. Each contribution will be evaluated in human subject studies with a commercial robot arm. This project has the potential to advance robotics in small and mid-sized manufacturing by making the process of teaching robot arms intuitive, transparent, and user-friendly.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
人类擅长通过示范和身体纠正来教授体育活动和任务(想象一下教练指导运动员完成期望的动作),人类学习者经常使用语言和非语言信号来传达他们的理解或困惑。人类和机器人之间也采用了类似的教学方法,允许人类自然地演示任务,如烹饪或家具组装,并纠正机器人运动中的错误。虽然机器人在理解人类教师的演示和纠正方面取得了很大的进步,但它们缺乏一种有效的方式来交流它们能理解什么和不理解什么,因此人类教师可能不知道机器人何时或是否准备好自己执行任务。该项目将通过开发机器人手臂在学习过程中与人类教师交流的新方法来解决这一沟通缺口。研究人员将在机械臂上安装触觉皮肤显示器(可控气泡阵列),并产生触觉,将机器人的理解或困惑传达给人类老师。机器人在学习过程中更好、更容易理解的交流将允许用户更有效地训练或再训练机器人,并更好地知道它们何时准备好部署,而不需要关于机器人如何工作的专业知识。这些特点将使机械臂对中小型制造商更具吸引力,使他们能够灵活地自动化一些制造任务。关于机械臂学习状态交流的经验教训也可以应用于其他计算机和机器人系统,使机器人和计算机学习的不透明过程更容易理解,并提供捕捉和纠正错误的机会。这个项目的目标是描述人类如何感知包裹在机器人手臂上的触觉皮肤显示,并形式化机器人如何通过这些触觉阵列捕获和交流反馈。先前的工作使机器人能够从物理演示中学习;然而,让这种学习对人类老师透明也同样重要。该项目将从算法和触觉的角度推进透明和可解释的机器人学习。研究小组将i)描述人类感知的探索性触觉反馈的类型和模式,ii)将机器人复杂的高维奖励学习嵌入到低维触觉反馈中,以及iii)模拟人类如何解释机器人的反馈。这些步骤最终将使人类教师了解机器人的理解能力,从而改进他们的演示。每一项贡献都将在商业机器人手臂的人体研究中进行评估。这个项目有可能通过使机器人手臂的教学过程直观、透明和用户友好来推进中小型制造业的机器人技术。该奖项反映了美国国家科学基金会的法定使命,并通过使用基金会的知识价值和更广泛的影响审查标准进行评估,被认为值得支持。

项目成果

期刊论文数量(3)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Wrapped Haptic Display for Communicating Physical Robot Learning
用于交流物理机器人学习的包裹式触觉显示器
Wrapping Haptic Displays Around Robot Arms to Communicate Learning
将触觉显示器包裹在机器人手臂周围以传达学习信息
  • DOI:
    10.1109/toh.2023.3240400
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    2.9
  • 作者:
    Alvarez Valdivia, Antonio;Habibian, Soheil;Mendenhall, Carly A.;Fuentes, Francesco;Shailly, Ritish;Losey, Dylan P.;Blumenschein, Laura H.
  • 通讯作者:
    Blumenschein, Laura H.
Perception of and Response to a Haptic Device as a Function of Signal Complexity
作为信号复杂性函数的触觉设备的感知和响应
  • DOI:
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Alvarez Valdivia, Antonio;Blumenschein, Laura H.
  • 通讯作者:
    Blumenschein, Laura H.
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Laura Blumenschein其他文献

Laura Blumenschein的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Laura Blumenschein', 18)}}的其他基金

Dynamic Shared Control for Soft Robots
软体机器人的动态共享控制
  • 批准号:
    2349067
  • 财政年份:
    2024
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: Increasing Capabilities of Heterogeneous Robot Teams through Mutually Beneficial Physical Interactions
协作研究:通过互利的物理交互提高异构机器人团队的能力
  • 批准号:
    2308653
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant

相似国自然基金

Research on Quantum Field Theory without a Lagrangian Description
  • 批准号:
    24ZR1403900
  • 批准年份:
    2024
  • 资助金额:
    0.0 万元
  • 项目类别:
    省市级项目
Cell Research
  • 批准号:
    31224802
  • 批准年份:
    2012
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research
  • 批准号:
    31024804
  • 批准年份:
    2010
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Cell Research (细胞研究)
  • 批准号:
    30824808
  • 批准年份:
    2008
  • 资助金额:
    24.0 万元
  • 项目类别:
    专项基金项目
Research on the Rapid Growth Mechanism of KDP Crystal
  • 批准号:
    10774081
  • 批准年份:
    2007
  • 资助金额:
    45.0 万元
  • 项目类别:
    面上项目

相似海外基金

Collaborative Research: HCC: Small: End-User Guided Search and Optimization for Accessible Product Customization and Design
协作研究:HCC:小型:最终用户引导的搜索和优化,以实现无障碍产品定制和设计
  • 批准号:
    2327136
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Medium: Aligning Robot Representations with Humans
合作研究:HCC:媒介:使机器人表示与人类保持一致
  • 批准号:
    2310757
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Small: Bridging Research and Visualization Design Practice via a Sustainable Knowledge Platform
合作研究:HCC:小型:通过可持续知识平台桥接研究和可视化设计实践
  • 批准号:
    2147044
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Small: RUI: Drawing from Life in Extended Reality: Advancing and Teaching Cross-Reality User Interfaces for Observational 3D Sketching
合作研究:HCC:小型:RUI:从扩展现实中的生活中汲取灵感:推进和教授用于观察 3D 草图绘制的跨现实用户界面
  • 批准号:
    2326998
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Small: Computational Design and Application of Wearable Haptic Knits
合作研究:HCC:小型:可穿戴触觉针织物的计算设计与应用
  • 批准号:
    2301355
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Medium: "Unboxing" Haptic Texture Perception: Closing the Loop from Skin Contact Mechanics to Novel Haptic Device
合作研究:HCC:媒介:“拆箱”触觉纹理感知:闭合从皮肤接触力学到新型触觉设备的循环
  • 批准号:
    2312153
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Small: Understanding Online-to-Offline Sexual Violence through Data Donation from Users
合作研究:HCC:小型:通过用户捐赠的数据了解线上线下性暴力
  • 批准号:
    2401775
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: NSF-CSIRO: HCC: Small: Understanding Bias in AI Models for the Prediction of Infectious Disease Spread
合作研究:NSF-CSIRO:HCC:小型:了解预测传染病传播的 AI 模型中的偏差
  • 批准号:
    2302969
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Small: Supporting Flexible and Safe Disability Representation in Social Virtual Reality
合作研究:HCC:小型:支持社交虚拟现实中灵活、安全的残疾表征
  • 批准号:
    2328183
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
Collaborative Research: HCC: Small: Computational Design and Application of Wearable Haptic Knits
合作研究:HCC:小型:可穿戴触觉针织物的计算设计与应用
  • 批准号:
    2301357
  • 财政年份:
    2023
  • 资助金额:
    $ 24.95万
  • 项目类别:
    Standard Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了