SBIR Phase II: Efficient Custom Machine Learning for Embedded Intelligence in the Internet of Things

这个小型企业创新研究（SBIR）第二阶段项目的更广泛的影响/商业潜力将导致通过支持许多垂直应用的水平平台技术部署机器学习（ML）解决方案的性能，功率和成本的显着改善。这一改进将加速智能系统的部署，并通过本地化智能提高可扩展性。我们的技术可实现硬件设计、实施和部署到现场可编程门阵列（FPGA）平台的自动化。我们的初始目标垂直市场：安全和监控、预测性维护和医疗保健在物联网设备的增长市场中占数千亿美元的份额，并通过提高部署和运营效率以及降低社会成本来产生更大的经济影响。通过在关键工业设备上部署预测性维护技术，这些关键技术的性能、功耗和可扩展性的改善将改善公共安全，提高家庭医疗服务的智能化程度，并提高制造和能源系统的效率。这些技术的广泛部署将导致大量的能源节约和相应的碳排放减少，减少由于负面事件造成的经济损失，提高可扩展性和对预测或主动负面事件的响应时间，以及由于低成本，低功耗和物理上小的传感器系统而降低部署和操作成本。用于ML应用程序的节能平台，以及相关的设计工具和库。神经网络被大量用于许多机器学习问题，但优化高效部署目前需要大量的试错，以获得大量的设计空间。我们的深度神经网络（DNN）优化框架应用位宽优化、权重共享和自动修剪，将计算和权重存储需求减少10倍以上，同时分析结果质量影响，并使用微调的再训练来最大限度地减少或消除精度下降。我们的高级综合（HLS）工具，然后将优化的网络硬件，同时应用流水线，功能单元并行，资源共享和平台特定的优化。这些工具共同自动化并加速了分析、优化和实施机器学习硬件部署的过程，减少了硬件设计所需的时间和专业知识。我们的部署平台是模块化、可组合的平台，适用于音频/视频信号处理、特征提取和分类、系统控制（例如云台变焦相机）以及与决策或云服务的通信的小型低成本部署。我们将通过安全/监控、预测性维护和医疗保健垂直领域的解决方案，以及平台、工具和IP库的紧密集成，扩展第一阶段项目的竞争优势。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase II project will result in a significant improvement in the performance, power, and cost of deploying machine learning (ML) solutions through horizontal platform technologies that enable many vertical applications. This improvement will accelerate deployment of intelligent systems and improve scalability through localized intelligence. Our technology automates hardware design, implementation, and deployment to Field-Programmable Gate Array (FPGA) platforms. Our initial target verticals: Security and Surveillance, Predictive Maintenance, and Healthcare represent hundreds of billions USD in growth markets for IoT devices and substantially more economic impact through improved efficiency in deployment and operations and reduced societal costs. Improved performance, power consumption and scalability of these key technologies will lead to improved public safety, improved intelligence in home healthcare services, and more efficient manufacturing and energy systems through deployment of Predictive Maintenance technologies on key industrial equipment. Wide deployment of these technologies will lead to substantial energy savings and a corresponding reduction in carbon emissions, reduced economic loss due to negative events, improved scalability and response time to predicted or active negative events, and lower cost in deployment and operations due to low cost, low power, and physically small sensor systems.The proposed project focuses on design of high performance, energy-efficient platforms for ML applications, and associated design tools and libraries. Neural networks are heavily used for many machine learning problems but optimizing for efficient deployment currently requires extensive trial-and-error for the large design space of options. Our deep neural network (DNN) optimization framework applies bit-width optimizations, weight sharing and pruning automatically to reduce computation and weight storage demands by more than 10X, while analyzing quality of results impact and using fine-tuned retraining to minimize or eliminate accuracy degradation. Our high level synthesis (HLS) tool then translates optimized networks to hardware while applying pipelining, functional unit parallelism, resource sharing, and platform-specific optimizations. Together these tools automate and accelerate the process of analyzing, optimizing and implementing ML for hardware deployment, reducing time and required expertise for hardware design. Our deployment platforms are modular, composable platforms for small, low-cost deployments of audio/video signal processing, feature extraction and classification, systems control (e.g. pan-tilt-zoom cameras), and communications to decision-making or cloud services. We will extend competitive advantages from our Phase I project with features for solutions in the security/surveillance, predictive maintenance, and healthcare verticals, and tight integration of platforms, tools and IP libraries.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.