NSF Convergence Accelerator Track H: Smart Wearables for Expanding Workplace Access for People with Blindness and Low Vision

全世界有2.85亿人失明和低视力(PBLV)。导致视力丧失的一个重要因素是失业率，在城市环境中，失业率高达81%。就业差距至少在很大程度上源于上下班的交通困难和工作场所本身的寻路问题。该项目通过最近开发的强大的辅助导航平台--空间智能和车载导航视障智能服务系统(VIS4ION)，在解决pBLV的就业挑战方面迈出了根本的一步。VIS4ION是一个谨慎的仪表化背包，背带上集成了一系列微型传感器，连接到嵌入式系统进行计算分析。通过双耳骨传导耳机和可选的重新配置的腰带翻转触觉接口提供实时反馈。该平台为pBLV提供了有价值的微服务，包括实时导航、场景分析和避障，所有这些都可以改变pBLV的工作场所体验。为了实现该项目的目标，一个跨学科团队带来了跨越工程(计算机视觉、触觉、传感器和无线)、医学(神经学和康复)和管理(组织变革和行为)的专业知识。这些学术学科与正在将技术商业化的初创企业触觉导航工具(TNT)、该领域的大型公司、专注于BLV的非营利性组织、灯塔行业协会和主要政府机构合作。在工作场所环境中开发和部署先进的互联可穿戴设备面临着巨大的技术、商业、社交和后勤挑战。这个翻译项目试图通过完成四个相互关联的任务来克服这些挑战：任务1执行第一个详细的、面向工作场所的研究，评估VIS4ION的导航精度，使用额外的摄像头和惯性测量单元进行测量；任务2构建在当前的VIS4ION接口之上，以建立可伸缩、可重现和成本更低的触觉反馈，以及新的基于音频的“认知助手”用于指导；任务3通过高速5G连接增强可穿戴设备，以提供实时、强大的基于云的机器视觉处理；任务4提供一系列新颖的研究，通过我们的合作伙伴LighTower Guild评估pBLV的工作场所体验。评估包括“大声思考”录音和背景反思。最近，BLV在全球范围内的总成本估计为3万亿美元。视力丧失和缺乏活动之间的病理联系会导致虚弱和失业。失去流动性会导致就业障碍，因为pBLV在日常通勤中挣扎，在工作场所认路，以及因大流行而加剧的多变的工作惯例。这项提议旨在提高可穿戴平台的安全性和易用性，从而在复杂的工作场所环境中实现“互联”的动态导航。扩展该平台的未来目标包括添加更多的社交功能，如人脸和情感识别，以实质性地改善更智能、更互联、残疾优先的城市景观中的生活质量。除了对科学、工程和改善pBLV生活的预期影响之外，该计划还将为临床和基础STEM/STEAM研究的研究生、本科生、医学生和高中生提供正式和非正式的学习机会。这些培训机会将培养多管齐下和多学科的团队方法，对开发复杂现实问题的创新解决方案至关重要。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

There are 285 million people with blindness and low vision (pBLV) worldwide. One dramatic correlate of vision loss is unemployment, with rates as high as 81% in urban environments. Employment disparities stem, at least in large part, from difficulties with transportation to and from work and wayfinding within the workplace itself. This project takes a fundamental step in addressing the employment challenges of pBLV through a recently developed, powerful assistive-navigation platform, the Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation (VIS4ION). VIS4ION is a discreet, instrumented backpack with an array of miniaturized sensors integrated into backstraps that connect to an embedded system for computational analysis. Real-time feedback is provided through a binaural bone conduction headset and an optional reconfigured waist strap turned haptic interface. The platform provides valuable micro-services for pBLV, including real-time navigation, scene analysis, and obstacle avoidance, all of which could transform workplace experiences for pBLV. To realize the goals of the project, a transdisciplinary team brings expertise across engineering (computer vision, haptics, sensors, and wireless), medicine (neurology and rehabilitation), and management (organizational change and behavior). These academic disciplines are partnered with a start-up, Tactile Navigation Tools (TNT), which is commercializing the technology, larger corporate firms in the space, a BLV-focused non-profit, Lighthouse Guild, and key government agencies. The development and deployment of advanced, connected wearables in workplace environments faces significant technical, business, social, and logistical challenges. This translational project seeks to overcome these challenges by completing four inter-connected tasks: Task 1 performs the first detailed, workplace-oriented study that assesses navigation accuracy of VIS4ION, as measured using additional cameras and inertial measurement units; Task 2 builds on the current VIS4ION interfaces to establish scalable, reproducible, and lower-cost tactile feedback, together with a new audio-based “cognitive assistant” for guidance; Task 3 augments the wearable with high-speed 5G connectivity to provide real-time, powerful cloud-based machine vision processing; Task 4 affords a series of novel studies to assess the workplace experiences of pBLV via our partner, Lighthouse Guild. The assessment includes both “think aloud” recordings and contextualized reflections. The total cost of BLV was recently estimated to be $3 trillion dollars globally. The pathologic link between vision loss and inactivity precipitates debility and unemployment. Mobility losses lead to employment barriers, as pBLV struggle during daily commuting, wayfinding in the workplace, and variable work routines that have been intensified by the pandemic. This proposal aims to increase the safety profile and ease-of-use of a wearable platform toward ‘connected’ dynamic navigation in complex workplace environments. Future goals for scaling the platform include adding additional social capabilities such as face and emotion recognition to substantively improve quality of life in a smarter and more connected, disability-first city landscape. Beyond the envisioned impact on science, engineering, and improving the lives of pBLV, this program will foster formal and informal learning opportunities for graduate, undergraduate, medical, and high school students in clinical and fundamental STEM/STEAM research. These training opportunities will foster multi-pronged and multi-disciplinary team approaches critical to the development of innovative solutions for complex real-world problems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.