CHS: Small: Collaborative Research: Increasing Social Connectedness in Telerobotic Platforms Through Adding Gesture Capabilities

CHS：小型：协作研究：通过添加手势功能增强远程机器人平台的社交联系

• 批准号: 1618926
• 负责人: Jenna Gorlewicz
• 金额: $ 25.15万
• 依托单位: Saint Louis University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-01-15 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1618926&HistoricalAwards=false
• 关键词: CHS; Small; Collaborative; Research; Increasing

This project will study how making common telepresence robots more expressive and interactive affects people's willingness to use them and their opinions of remote collaborators. Many telepresence robots take the form of a screen on a mobile platform, giving remote attendees a physical body that can increase feelings of presence and interaction compared to a normal videoconference. However, the limited non-verbal expressiveness of these platforms is a major barrier to their use. Thus, the research goal is to increase the embodiment and social interaction capabilities of these platforms by adding a hand and arm to support common non-verbal interactions such as pointing, gesturing, and touch. To do this, the researchers will first build a simple hand and arm to support these non-verbal interactions and add it to an existing telepresence robot. They will then develop software to run on the robot to execute the gestures and ensure the safety of people nearby, as well as a user interface that maps gestures by the remote user onto gestures the hand and arm are able to execute. They will then test the usability of the system and its effects on social presence through studies that include both one-on-one and small group icebreaking conversations. This work will lead toward more natural interfaces for telepresence robots and a better understanding of how people accept them and interact with them. This, in turn, should lead to social benefits by making remote interaction more effective, saving time, effort, and fuel costs around travel while supporting not just remote meetings but other remote services such as medical diagnosis and caregiving. The team will also use the research both for their own classes and for outreach at events designed to encourage children to explore science careers. The work sits at the intersection of telerobotics, haptics, and social psychology. Because gestures, pointing, handshakes, and other non-verbal communication are an important part of human interaction that current telepresence platforms do not support, the work focuses on the development of a lightweight arm that can implement those gestures without the complexity, fragility, and expense of arms that fully mimic human motion. To make this tradeoff, the research team will develop a 3D-printed, 5-fingered hand with 3 degrees of freedom and simple connections that allow the fingers to bend naturally enough to recreate the intended gestures. The control software will use a forward and inverse kinematics approach to model hand configurations and use an open-loop controller that works along with the human operator to implement the gestures; bump, force, and optical sensors will be used to address safety concerns. For the human remote operator, the team will develop interfaces that (a) add cameras to the robot to provide a fuller view of the remote environment needed for effective gestures, and (b) use motion-tracking hardware to detect the remote user's arm motion and translate it into the space of possible motions of the robot arm, focusing on the specific targeted social gestures. They will evaluate the system through a series of between-subjects user studies, having participants as either the remote or local user interacting with a version of the robot with or without the arm. Participants will interact with trained experimental confederates both to reduce variability and to ensure that the target non-verbal gestures are experienced in both the with- and without-arm conditions. The team will measure perceived social connectedness with conversation partners and acceptability of the robot using standard scales, as well as asking questions about the particulars of the experience both to gain deeper insight into the reasons why the arm is effective (if it is) and to guide the design of future systems.

这个项目将研究如何使普通的远程呈现机器人更具表达力和互动性，影响人们使用它们的意愿和他们对远程合作者的看法。 许多远程呈现机器人采用移动的平台上的屏幕形式，为远程与会者提供物理身体，与普通视频会议相比，可以增加在场感和互动感。 然而，这些平台有限的非语言表达能力是其使用的主要障碍。 因此，研究目标是通过添加手和手臂来支持常见的非语言交互，例如指向，手势和触摸，从而增加这些平台的体现和社交交互能力。 为此，研究人员将首先构建一个简单的手和手臂来支持这些非语言交互，并将其添加到现有的远程呈现机器人中。 然后，他们将开发在机器人上运行的软件，以执行手势并确保附近人员的安全，以及将远程用户的手势映射到手和手臂能够执行的手势的用户界面。 然后，他们将通过包括一对一和小组破冰对话在内的研究来测试该系统的可用性及其对社会存在的影响。 这项工作将为远程呈现机器人带来更自然的界面，并更好地了解人们如何接受它们并与它们互动。 这反过来又会带来社会效益，使远程交互更加有效，节省旅行的时间、精力和燃料成本，同时不仅支持远程会议，还支持其他远程服务，如医疗诊断和咨询。 该团队还将利用这项研究为自己的课程和旨在鼓励孩子们探索科学事业的活动进行推广。这项工作位于远程机器人，触觉和社会心理学的交叉点。 由于手势、指向、握手和其他非语言交流是当前远程呈现平台不支持的人类交互的重要组成部分，因此这项工作的重点是开发一种轻量级手臂，这种手臂可以实现这些手势，而不会像完全模仿人类运动的手臂那样复杂、脆弱和昂贵。 为了做出这种权衡，研究团队将开发一种3D打印的5指手，具有3个自由度和简单的连接，允许手指足够自然地弯曲以重现预期的手势。 控制软件将使用正向和反向运动学方法来模拟手部配置，并使用开环控制器，该控制器与人类操作员一起沿着来实现手势;碰撞、力和光学传感器将用于解决安全问题。 对于人类远程操作员，该团队将开发接口，（a）为机器人添加摄像头，以提供有效手势所需的远程环境的更全面视图，以及（B）使用运动跟踪硬件来检测远程用户的手臂运动，并将其转换为机器人手臂的可能运动空间，专注于特定的目标社交手势。 他们将通过一系列受试者之间的用户研究来评估该系统，让参与者作为远程或本地用户与有或没有手臂的机器人版本进行交互。参与者将与训练有素的实验员进行交互，以减少可变性并确保在有和没有手臂的条件下都能体验到目标非语言手势。 该团队将使用标准量表测量与对话伙伴的感知社交联系以及机器人的可接受性，并询问有关体验细节的问题，以更深入地了解手臂有效的原因（如果有效）并指导未来系统的设计。