I-Corps: Semio: Customer discovery for a software platform for human-robotic interactions

I-Corps：Semio：人机交互软件平台的客户发现

• 批准号: 1641982
• 负责人: Andrea Belz
• 金额: $ 5万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-06-15 至 2017-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1641982&HistoricalAwards=false
• 关键词: Corps; Semio; Customer; discovery; software

This I-Corps team is developing a standardized software platform to allow humans to interact with and use robots through natural communication, such as speech and body language. The proposed "Semio" software platform allows robot developers to create (through developer tools) and deploy (to an app store) speech/gesture-based applications to be executed by robots, and allows non-expert robot users to access (from the app store) and use (through natural communication and smart devices) those robot applications. The proposed software enables a robot to automatically recognize human speech and body language, make decisions about how to respond (specified by the developer for the application), and act based on those decisions while also providing its own speech and body language. This natural communication interface increases the usability of robots by novice users. The Semio software platform involves novel algorithms and robust code bases that enable a robotic hardware platform to operate "out of the box" based on a set of core social behaviors that serve as building blocks of face-to-face conversational interaction; these behaviors include speech (what is said), eye gaze (where attention is focused), gestures (face, head, body, arm, and hand movements), turn-taking (when to talk and when to listen), and interpersonal spacing (where to stand for to have a conversation). The target market for the proposed speech/gesture-based software is personal robotics, though the team is also exploring other markets, such as smart devices (smart phones, GPS, and the Internet of Things), gaming, transportation (cars and self-driving cars), sensors (Microsoft Kinect and Intel RealSense), and general robotics (industrial, military, and commercial robotics). The team is currently targeting customers who are hardware and software developers of these interactive technologies. Developers may be both expert and non-expert, and may be members of industry, the Maker community, hobbyists, or academia. Through repeated customer interviews, this team will continue to integrate customer feedback into the demo app to better improve the product content and performance to meet the identified needs of customers. The software platform will also be connected to a hardware robot platform to begin proof-of-concept demonstrations to and connection-building with prospective customers in the robotics market.

这个I-Corps团队正在开发一个标准化的软件平台，允许人类通过自然交流（如语音和肢体语言）与机器人进行交互和使用。所提出的“Semio”软件平台允许机器人开发者创建（通过开发者工具）和部署（到应用商店）将由机器人执行的基于语音/手势的应用，并允许非专家机器人用户访问（从应用商店）和使用（通过自然通信和智能设备）这些机器人应用。所提出的软件使机器人能够自动识别人类语音和肢体语言，决定如何响应（由应用程序的开发人员指定），并根据这些决定采取行动，同时还提供自己的语音和肢体语言。这种自然的通信接口增加了新手用户对机器人的可用性。Semio软件平台包括新颖的算法和强大的代码库，使机器人硬件平台能够基于一组核心社交行为“开箱即用”，这些行为作为面对面对话交互的构建块;这些行为包括言语（说什么），眼睛凝视（注意力集中的地方），手势（面部、头部、身体、手臂和手的动作）、话轮转换（何时说话，何时倾听）和人际间距（在对话中代表什么）。基于语音/手势的软件的目标市场是个人机器人，尽管该团队也在探索其他市场，如智能设备（智能手机，GPS和物联网），游戏，交通（汽车和自动驾驶汽车），传感器（Microsoft Kinect和Intel RealSense）和通用机器人（工业，军事和商业机器人）。该团队目前的目标客户是这些交互技术的硬件和软件开发人员。开发人员可能是专家和非专家，也可能是行业、Maker社区、业余爱好者或学术界的成员。通过反复的客户访谈，该团队将继续将客户反馈整合到演示应用程序中，以更好地改进产品内容和性能，以满足客户的需求。该软件平台还将连接到硬件机器人平台，以开始概念验证演示，并与机器人市场的潜在客户建立联系。