SBIR Phase II: Large-Scale Behavioral Analysis Utilizing Convolutional Neural Networks and Its Application to In-store Retail Marketing

SBIR 第二阶段：利用卷积神经网络的大规模行为分析及其在店内零售营销中的应用

• 批准号: 1738492
• 负责人: Everett Berry
• 金额: $ 75万
• 依托单位: Perceive, Inc.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2017
• 资助国家: 美国
• 起止时间: 2017-09-15 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1738492&HistoricalAwards=false
• 关键词: SBIR; Phase; II; Large; Scale

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase II project will be to enhance infrastructure for research and education by exposing a previously unavailable dataset: fine-grained human interaction with a physical environment. Humans are always building on and shaping the world but there is little hard data to further examine the effects this has. Beyond retail, this technology could affect how teachers layout classrooms, how disaster workers provide relief, or how factories keep their workers safe. The subtle physical details that affect humans everyday will be understood and investigated in ways not possible without the proposed system. This technology will benefit society by increasing economic efficiency because retailers can meet customer needs more easily. This translates into large potential commercial value because of the size of the retail market and because retailers are under pressure to deliver differentiated customer experiences that customers cannot get online or at big-box stores. Such experiences are enabled by understanding the customer at a much deeper level which in turn is enabled by the technology proposed here.This Small Business Innovation Research (SBIR) Phase II project uses sensor placement models, statistical methods, and face recognition to fully realize the commercial potential resulting from the Phase I development of a video analytics system for understanding human behavior. Research in video-based behavior recognition has seen renewed excitement because of deep learning but current work only addresses pieces of the problem. Critical missing components are robust face identification and registration, a process to install as few cameras as possible while maximizing the viewable area of a store, and video analysis results that are meaningful when combined with other data such as retail transactions. The research objectives of extracting biometric data (such as facial features) from video, automatically computing the optimal positions of cameras, and correlating behavior metrics with business operations are essential to improve the retail experience for shoppers and make the developments undertaken in Phase I more commercially relevant to potential end users of the technology.

这个小企业创新研究（SBIR）第二阶段项目的更广泛的影响/商业潜力将是通过揭示以前不可用的数据集来增强研究和教育的基础设施：细粒度的人类与物理环境的交互。人类总是在构建和塑造世界，但几乎没有确凿的数据来进一步研究这种影响。除了零售业，这项技术还可能影响教师布置教室的方式、救灾人员提供救援的方式，或者工厂如何保障工人的安全。影响人类日常生活的细微物理细节将被理解和研究，如果没有这个系统，这是不可能的。这项技术将通过提高经济效率来造福社会，因为零售商可以更容易地满足顾客的需求。这将转化为巨大的潜在商业价值，因为零售市场的规模，因为零售商面临着提供差异化客户体验的压力，而客户无法在网上或大型商店获得这种体验。这样的体验是通过在更深层次上理解客户来实现的，而这又通过本文提出的技术来实现。这个小企业创新研究（SBIR）第二阶段项目使用传感器放置模型、统计方法和人脸识别来充分实现第一阶段开发的视频分析系统的商业潜力，以了解人类行为。由于深度学习的出现，基于视频的行为识别研究重新激起了人们的热情，但目前的工作只解决了问题的一部分。关键的缺失部分是强大的人脸识别和注册，尽可能少地安装摄像头，同时最大限度地扩大商店的可见区域，以及当与零售交易等其他数据相结合时有意义的视频分析结果。从视频中提取生物特征数据（如面部特征），自动计算摄像头的最佳位置，并将行为指标与商业运营相关联，这些研究目标对于改善购物者的零售体验至关重要，并使第一阶段所进行的开发与该技术的潜在最终用户更具商业相关性。