SBIR Phase I: Robotic system outputting natural tactile-sign language to aid Deaf and Deafblind communication

这个小型企业创新研究（SBIR）第一阶段项目的更广泛的影响/商业潜力将有助于低成本拟人机器人和机器翻译领域。利用低成本制造和深度学习的进步，该项目正在开发一种具有强大远程处理功能的可访问和最先进的投诉机器人。使用远程处理，以避免昂贵的微处理器和存储能力，拟议的云服务器可以捕捉任何基于wifi的通信和娱乐，同时翻译语言与自定义标准和用户的喜好在实时。通过授予DeafBlind（DB）个人新的独立性和隐私权，该项目的成功将彻底改变DB个人与社区的互动方式，并提供对残疾人世界资源的直接访问。市场机会估计为每年2130亿美元。该产品将对辅助技术领域产生重大影响，目标是历史上服务不足的DB人群，对他们来说几乎没有创新。重要的是，这将是第一个商业化的签名机器人。这个小型企业创新研究（SBIR）第一阶段项目将为聋哑人（DB）提供一个方便和可访问的方法来与世界互动。目前，DB社区缺乏沟通助手，需要所有患有严重双盲症的人依靠人类翻译与听力/视力世界互动。然而，由于这些昂贵的服务需要大量的交付时间，DB个人经常会遇到孤立和孤独。本研究的目的是实现一个完全兼容的，灵活的指法拟人手。此外，本研究旨在开发第一个用于口语和手语之间翻译的架构。技术研究需要对连续运动的运动捕获映射和存储以及肌腱驱动方案进行调查，以实现低成本的18自由度机器人手。此外，语言学研究探索DB语言的使用（语法，形态，符号生产等）。以及基于人口统计数据的偏好。预计的技术成果包括一个机器人手，可以签署与90%的识别率从DB用户，签署速度从一个到两个迹象之间的源语言和输出的触觉标志准确的翻译模式的变化。这一奖项反映了NSF的法定使命，并已被认为是值得通过评估使用基金会的智力价值和更广泛的影响审查标准的支持。

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase I project will contribute to the fields of low-cost anthropomorphic robotics as well as machine translation. Leveraging advancements in low-cost manufacturing and deep learning, the project is developing an accessible and state-of-the-art complaint robot with robust remote processing. Using remote processing to avoid expensive microprocessors and memory capabilities, the proposed cloud server can capture any wifi-based communication and entertainment, while translating language with custom standards and user preferences in real-time. By granting DeafBlind (DB) individuals newfound independence and privacy, the success of the project will revolutionize how DB individuals interact with their community as well as provide immediate access to the abled world’s resources. The market opportunity is estimated at $213 billion annually. This product will have a significant impact on the assistive technology field, targeting the historically underserved DB populations, for whom there is little innovation. Importantly, this would be the first commercialized signing robot. This Small Business Innovation Research (SBIR) Phase I project will provide a convenient and accessible method for DeafBlind (DB) people to interact with the world. The current lack of communication aides among the DB community requires all people with severe deafblindness to rely on human interpreters to interact with the hearing/sighted world. However, with extensive lead times for these expensive services, DB individuals regularly experience isolation and loneliness. This research aims to achieve a fully compliant, flexible fingerspelling anthropomorphic hand. Additionally, this research aims to develop the first architecture for translating between a spoken and signed language. Technical research requires investigation into motion capture mapping and storage of continuous motion as well as tendon actuation schemes to achieve a low-cost 18 degrees of freedom robotic hand. Additionally, linguistics research explores DB language usage (syntax, morphology, sign production, etc.) as well as preferences based on demographic data. Anticipated technical results include a robotic hand that can sign with 90% recognition from DB users, signing at variable speeds ranging from one to two signs per second with accurate translation patterns between the source language and outputted tactile signs.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.