CNS Core: Small: Enabling Real-time, Scalable and Secure Collaborative Intelligence on the Edge

随着嵌入式系统的激增，多核计算设备实现了将计算从集中式云转移到分布式边缘平台的最新趋势。 这一趋势在智慧城市的智能基础设施中产生了新的产品和服务。然而，随着实时工作负载在边缘计算平台上执行，性能瓶颈从边缘云通信转移到片上通信。该系统的实时性能面临着片上网络（NoC）的新系统架构挑战，即可扩展性和安全性。 这些挑战与不同用户之间的动态数据分布有关。本计画旨在设计一个即时且可扩充的片上网络，以实现即时的协同学习演算法。核心策略是协调系统架构和算法的协同设计，以探索边缘计算平台上的新设计空间。为了应对研究挑战，我们将开发一个全面的架构，通过硬件和软件的协同设计来解决这些多方面的问题，包括三个关键方面：（i）设计一个互连，以消除NoC上的不可预测性障碍;（ii）为协作学习系统建立一个可扩展的虚拟化事务环境，保证所有实时事务任务都能在正确的时间完成;（iii）根据新提出的架构，在边缘平台上实现一个实时、安全的多目标跟踪系统。拟议的研究将使用物理平台Equinox进行评估，室内和室外研究超出了模拟。这项研究将开辟研究和教育机会的新维度。特别是，该项目的成功将提供一个硬件/软件包，可以增强边缘的实时协作计算。由此产生的互连和Equinox是即用型平台，可以让专家/研究人员轻松检查他们关于协作学习和实时边缘计算的研究设计，从而缩小不同研究领域之间的差距。教育工作将致力于（i）本科和研究生课程的课程设计，（ii）初中和高中学生和教师的夏令营开发，（iii）扩大韦恩州立大学对计算和工程的参与。数据，代码，模拟器，在整个项目期间和项目结束后至少五年内，将向公众提供本项目开发的技术和平台。该项目库将在韦恩州立大学网站（http：//zheng.eng.wayne.edu/index.html）和CAR实验室网站（https：//www.example.com）上提供。该奖项反映了NSF的法定使命，并被认为值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估来支持。

With the proliferation of embedded systems, multicore computing devices enable the recent trend of moving computation from the centralized cloud to distributed edge platforms. This trend yields new products and services across smart infrastructures in smart cities. However, as real-time workloads are executed at the edge computing platforms, the performance bottleneck is transferred from the edge-cloud communication to on-chip communication. The system’s real-time performance faces new system-architectural challenges for the Network-On-Chip (NoC), which are scalability and security. These challenges are hinged with dynamic data distributions across different users. This project aims to design a real-time and scalable NoC for implementing real-time collaborative learning algorithms. The key strategy is to orchestrate a system-architecture and algorithm co-design to explore the new design space on the edge computing platform.To cope with the research challenges, a comprehensive architecture will be developed to address these multifaceted problems through a hardware and software co-design, which consists of three key thrusts: (i) designing an interconnect, which will eliminate non-predictability barrier on the NoC; (ii) establishing a scalable virtualized transaction environment for the collaborative learning system to guarantee that all the real-time transaction tasks can complete at the right time; (iii) implementing a real-time and secure multi-target tracking system on the edge platform in light of the newly proposed architecture. The proposed research will be evaluated using the physical platform Equinox, with indoor and outdoor studies beyond simulation.This research will open a new dimension of research and educational opportunities. In particular, the success of the project will provide a hardware/software package that can enhance the real-time collaborative computing on the edge. The resulted interconnect and Equinox are ready-to-use platforms that will allow experts/researchers to easily examine their research designs regarding collaborative learning and real-time edge computing, thereby sealing the gap between different research fields. Educational efforts will be devoted to (i) curriculum design for the undergraduate and graduate program, (ii) summer camp development for middle and high school students, and teachers, (iii) broadening participation in computing and engineering, at the Wayne State University.The data, codes, simulators, and platforms developed in this project will be made available publicly throughout the duration of the project and for at least five years after the end of the project. The project repository will be available on Wayne State University website (http://zheng.eng.wayne.edu/index.html) and the website of the CAR Lab (https://www.thecarlab.org/.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.