NSF Convergence Accelerator Track H: Smart Wearables for Expanding Workplace Access for People with Blindness and Low Vision

全世界有2.85亿人患有失明和低视力（pBLV）。视力丧失的一个显着相关因素是失业，城市环境中的失业率高达81%。就业不平等至少在很大程度上是由于上下班交通困难和工作场所本身的寻路困难。该项目通过最近开发的功能强大的辅助导航平台，即空间智能和车载导航视觉障碍智能服务系统（VIS 4 ION），在解决pBLV的就业挑战方面迈出了根本性的一步。VIS 4 ION是一个谨慎的，装有仪器的背包，背包上集成了一系列微型传感器，这些传感器连接到嵌入式系统进行计算分析。通过双耳骨传导耳机和可选的重新配置的腰带转向触觉接口提供实时反馈。该平台为pBLV提供了有价值的微服务，包括实时导航、场景分析和避障，所有这些都可以改变pBLV的工作场所体验。为了实现该项目的目标，一个跨学科的团队带来了工程（计算机视觉，触觉，传感器和无线），医学（神经病学和康复）和管理（组织变革和行为）的专业知识。这些学科与一家初创公司Tactile Navigation Tools（TNT）合作，该公司正在将该技术商业化，该领域的大型企业，一家专注于BLV的非营利组织Lighthouse Guild和主要政府机构。在工作环境中开发和部署先进的互联可穿戴设备面临着重大的技术、业务、社会和物流挑战。这个翻译项目旨在通过完成四个相互关联的任务来克服这些挑战：任务1执行第一个详细的，面向工作场所的研究，评估VIS 4 ION的导航精度，使用额外的相机和惯性测量单元进行测量;任务2建立在当前的VIS 4 ION接口上，以建立可扩展、可再现和低成本的触觉反馈，任务3通过高速5G连接增强可穿戴设备，以提供实时、强大的基于云的机器视觉处理;任务4提供了一系列新颖的研究，通过我们的合作伙伴Lighthouse Guild评估pBLV的工作场所体验。评估包括“大声思考”录音和情境化反思。BLV的总成本最近估计为3万亿美元。视力丧失和不活动之间的病理联系会导致虚弱和失业。流动性的丧失导致就业障碍，因为pBLV在日常通勤、工作场所的寻路以及因大流行而加剧的可变工作例程中挣扎。该提案旨在提高可穿戴平台的安全性和易用性，以实现复杂工作环境中的“连接”动态导航。扩展该平台的未来目标包括增加额外的社交功能，如面部和情感识别，以大幅提高生活质量，在一个更智能，更互联，残疾人优先的城市景观。除了对科学，工程和改善pBLV生活的预期影响外，该计划还将为研究生，本科生，医学生和高中生提供临床和基础STEM/STEAM研究的正式和非正式学习机会。这些培训机会将促进多管齐下和多学科的团队方法，这对复杂的现实世界问题的创新解决方案的发展至关重要。该奖项反映了NSF的法定使命，并已被认为是值得通过使用基金会的智力价值和更广泛的影响审查标准进行评估的支持。

There are 285 million people with blindness and low vision (pBLV) worldwide. One dramatic correlate of vision loss is unemployment, with rates as high as 81% in urban environments. Employment disparities stem, at least in large part, from difficulties with transportation to and from work and wayfinding within the workplace itself. This project takes a fundamental step in addressing the employment challenges of pBLV through a recently developed, powerful assistive-navigation platform, the Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation (VIS4ION). VIS4ION is a discreet, instrumented backpack with an array of miniaturized sensors integrated into backstraps that connect to an embedded system for computational analysis. Real-time feedback is provided through a binaural bone conduction headset and an optional reconfigured waist strap turned haptic interface. The platform provides valuable micro-services for pBLV, including real-time navigation, scene analysis, and obstacle avoidance, all of which could transform workplace experiences for pBLV. To realize the goals of the project, a transdisciplinary team brings expertise across engineering (computer vision, haptics, sensors, and wireless), medicine (neurology and rehabilitation), and management (organizational change and behavior). These academic disciplines are partnered with a start-up, Tactile Navigation Tools (TNT), which is commercializing the technology, larger corporate firms in the space, a BLV-focused non-profit, Lighthouse Guild, and key government agencies. The development and deployment of advanced, connected wearables in workplace environments faces significant technical, business, social, and logistical challenges. This translational project seeks to overcome these challenges by completing four inter-connected tasks: Task 1 performs the first detailed, workplace-oriented study that assesses navigation accuracy of VIS4ION, as measured using additional cameras and inertial measurement units; Task 2 builds on the current VIS4ION interfaces to establish scalable, reproducible, and lower-cost tactile feedback, together with a new audio-based “cognitive assistant” for guidance; Task 3 augments the wearable with high-speed 5G connectivity to provide real-time, powerful cloud-based machine vision processing; Task 4 affords a series of novel studies to assess the workplace experiences of pBLV via our partner, Lighthouse Guild. The assessment includes both “think aloud” recordings and contextualized reflections. The total cost of BLV was recently estimated to be $3 trillion dollars globally. The pathologic link between vision loss and inactivity precipitates debility and unemployment. Mobility losses lead to employment barriers, as pBLV struggle during daily commuting, wayfinding in the workplace, and variable work routines that have been intensified by the pandemic. This proposal aims to increase the safety profile and ease-of-use of a wearable platform toward ‘connected’ dynamic navigation in complex workplace environments. Future goals for scaling the platform include adding additional social capabilities such as face and emotion recognition to substantively improve quality of life in a smarter and more connected, disability-first city landscape. Beyond the envisioned impact on science, engineering, and improving the lives of pBLV, this program will foster formal and informal learning opportunities for graduate, undergraduate, medical, and high school students in clinical and fundamental STEM/STEAM research. These training opportunities will foster multi-pronged and multi-disciplinary team approaches critical to the development of innovative solutions for complex real-world problems.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.