US Ignite: Focus Area 1: Predictable Wireless Networking and Collaborative 3D Reconstruction for Real-Time Augmented Vision

US Ignite：重点领域 1：用于实时增强视觉的可预测无线网络和协作 3D 重建

• 批准号: 1647200
• 负责人: Hongwei Zhang
• 金额: $ 60万
• 依托单位: Wayne State University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2016
• 资助国家: 美国
• 起止时间: 2016-10-01 至 2018-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1647200&HistoricalAwards=false
• 关键词: US; Ignite; Focus; Area; Predictable

Eliminating the line-of-sight constraint of human vision and machine vision, the developed network systems foundations of predictable wireless networked and 3D reconstruction will enable 'see-through vision' which will transform the ways humans and engineered systems interact with environments and thus have far-reaching impact on domains such as road transportation, public safety, and disaster response. This project develops the network systems foundation for a vehicle equipped with sensors and an augmented reality display to indicate the presence of other nearby vehicles hidden by obstacles. In collaboration with Wayne State University (WSU) police and Ford Research and leveraging the WSU living lab and the OpenXC open-source platform for connected vehicles, the project will take an integrated approach to the research, deployment, and dissemination of the wireless network systems for see-through vision. This project proposes a cross-layer framework for addressing physical-domain uncertainties and the interdependencies between wireless networking and 3D reconstruction, and it develops novel algorithms for predictable wireless networking and real-time wireless networked 3D reconstruction. Using the developed network system, this project will develop a see-through vision application for human-driving. The wireless networked see-through vision system will be deployed in the WSU police patrol vehicles, and the project team will outreach to the Detroit and State of Michigan police as well as open-source communities for broad adoption and deployment of the see-through vision system.With the bold objective of eliminating the line-of-sight constraint of human vision and machine vision, this project addresses wireless networking and 3D reconstruction challenges in a holistic cross-layer framework. By integrating research investigation with systems development and deployment, this project will make the following significant contributions: 1) Effectively leveraging multi-scale physical structures of traffic flows, the multi-scale approach to resource management in vehicular wireless networks not only ensures predictable vehicular wireless networking, it also transforms fundamental challenges of vehicular networks to ones similar to those of mostly-immobile networks, thus enabling the exploration of fundamental, generically-applicable principles and mechanisms for predictable wireless networking; 2) the multi-scale approach to joint scheduling, channel assignment, power control, and rate control enables predictable control of per-packet transmission reliability in the presence of fast-varying network and environmental conditions such as wireless channel attenuation, internal and external interference, data traffic dynamics, and vehicle mobility; 3) the real-time scheduling algorithm enables controllable exploration of real-time capacity regions for system-level optimization; 4) the collaborative 3D reconstruction model integrates visual sensors in a divide-and-conquer fashion, and it enhances the capability of networked vision as well as its robustness to physical uncertainties; 5) the co-design of collaborative 3D reconstruction and wireless networking permits adaptive communication capacity allocation to optimize the quality of 3D reconstruction; 6) the attention-aware see-through vision application creates a new research field of vision augmentation by uniquely integrating computer vision and computer graphics research and by proposing a practical solution for displaying augmented 3D vision.

消除人类视觉和机器视觉的视线限制，可预测的无线网络和3D重建的网络系统基础将实现“透视视觉”，这将改变人类和工程系统与环境交互的方式，从而对道路交通、公共安全和灾难响应等领域产生深远的影响。该项目为配备传感器和增强现实显示器的车辆开发网络系统基础，以指示附近被障碍物隐藏的其他车辆的存在。 该项目将与韦恩州立大学 (WSU) 警方和福特研究中心合作，利用 WSU 生活实验室和 OpenXC 联网车辆开源平台，采用综合方法来研究、部署和传播无线网络系统，以实现透视视觉。该项目提出了一个跨层框架，用于解决物理域的不确定性以及无线网络和 3D 重建之间的相互依赖性，并开发了用于可预测无线网络和实时无线网络 3D 重建的新颖算法。利用已开发的网络系统，该项目将开发用于人类驾驶的透视视觉应用程序。无线联网透视视觉系统将部署在 WSU 警察巡逻车中，项目团队将联系底特律和密歇根州警察以及开源社区，以广泛采用和部署透视视觉系统。该项目的大胆目标是消除人类视觉和机器视觉的视线限制，全面解决无线网络和 3D 重建挑战。 跨层框架。通过将研究调查与系统开发和部署相结合，该项目将做出以下重大贡献： 1）有效利用交通流的多尺度物理结构，车载无线网络中的多尺度资源管理方法不仅确保了可预测的车载无线网络，还将车载网络的基本挑战转化为与大多数固定网络类似的挑战，从而使探索 可预测无线网络的基本、普遍适用的原则和机制； 2) 联合调度、信道分配、功率控制和速率控制的多尺度方法能够在快速变化的网络和环境条件（例如无线信道衰减、内部和外部干扰、数据流量动态和车辆移动性）的情况下对每个数据包的传输可靠性进行可预测的控制； 3）实时调度算法能够实现实时容量区域的可控探索，以实现系统级优化； 4）协作3D重建模型以分而治之的方式集成视觉传感器，增强了网络视觉的能力及其对物理不确定性的鲁棒性； 5）协同3D重建和无线网络的协同设计允许自适应通信容量分配以优化3D重建的质量； 6）注意力感知透视视觉应用通过独特地整合计算机视觉和计算机图形学研究并提出显示增强3D视觉的实用解决方案，开创了视觉增强的新研究领域。

项目成果

Robust 3D face modeling and reconstruction from frontal and side images

• DOI: 10.1016/j.cagd.2016.11.001
• 发表时间: 2017
• 期刊: Comput. Aided Geom. Des.
• 作者: Hai Jin;Xun Wang;Z. Zhong;Jing Hua

Kernel-based adaptive sampling for image reconstruction and meshing

• DOI: 10.1016/j.cagd.2016.02.013
• 发表时间: 2016-03
• 期刊: Comput. Aided Geom. Des.
• 作者: Z. Zhong;Jing Hua

Cyber-Physical Scheduling for Predictable Reliability of Inter-Vehicle Communications

• DOI: 10.1109/tvt.2020.2968591
• 发表时间: 2020-01
• 期刊: IEEE Transactions on Vehicular Technology
• 影响因子: 6.8
• 作者: Chuan Li;Hongwei Zhang;Tianyi Zhang;J. Rao;L. Wang;G. Yin

Visualizing Shape Deformations with Variation of Geometric Spectrum

• DOI: 10.1109/tvcg.2016.2598790
• 发表时间: 2017
• 期刊: IEEE Transactions on Visualization and Computer Graphics
• 影响因子: 5.2
• 作者: Jiaxi Hu;Hajar Hamidian;Z. Zhong;Jing Hua

Optimal Request Clustering for Link Reliability Guarantee in Wireless Networked Control

• DOI: 10.1109/wcnc.2017.7925790
• 发表时间: 2017-03
• 期刊: 2017 IEEE Wireless Communications and Networking Conference (WCNC)
• 作者: Yu Chen;Hongwei Zhang