CSR: Small: Collaborative Research: Overheard at Home - Mitigating Overhearing of Continuous Listening Devices

CSR：小：协作研究：在家无意中听到的声音 - 减轻连续监听设备的无意中听到的情况

• 批准号: 1815274
• 负责人: Xiaofan Jiang
• 金额: $ 24.8万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2018
• 资助国家: 美国
• 起止时间: 2018-10-01 至 2023-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1815274&HistoricalAwards=false
• 关键词: CSR; Small; Collaborative; Research; Overheard

Smart home devices that converse with humans are becoming popular day by day. These hands-free, Internet-connected devices continuously listen to their surroundings, so that whenever someone speaks to them, they can respond right away. In the presence of such always-listening devices at home, people are at the greatest risk of privacy invasion. For instance, a hacker can hack into these devices and listen to everything one says or every sound one makes at home. The goal of this project is to thwart such attacks and to ensure that continuously listening devices do not overhear anything that they should not. This project takes a generalized approach to solve the overhearing problem of any acoustic sensing system. A programmable acoustic filter will be developed, which will inspect and filter out user-defined sounds before audio signals enter into an untrusted acoustic sensing system. To achieve this, the project is organized in four research tasks: (a) devising algorithms to separate a large number of sound sources on resource-constrained embedded platforms; (b) devising algorithms to count the number of active sources in real-time; (c) developing sound recognition algorithms that require very little training data; and (d) developing a custom, low-power, miniature embedded system. Privacy-preserving mobile health applications are important to bringing personalized and low-cost healthcare to the mass of people which they can trust. The system will be deployed in two audio-based mobile health applications: asthma and sleep monitoring, where privacy is of utmost importance. Hardware and software materials developed in this project will be used in graduate and undergraduate level courses at both University of North Carolina and Columbia University. This award will support a female graduate student. Research results will be demonstrated at outreach events, as well as through online course offerings, and conference publications. Anonymized datasets, algorithms, code, and the design of the embedded system will be shared with the research community through a website (https://overhearing.web.unc.edu/). The website is hosted at the University of North Carolina at Chapel Hill. The repository will be publicly accessible and will be kept up-to-date throughout the 3-year project. The website will remain alive beyond the project period for as long as possible.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

与人类匡威的智能家居设备正日益流行。这些免提、互联网连接的设备持续监听周围环境，因此，无论何时有人对它们说话，它们都可以立即做出回应。在家中有这种始终监听设备的情况下，人们的隐私受到侵犯的风险最大。例如，黑客可以侵入这些设备，监听人们在家里说的每一句话或发出的每一个声音。该项目的目标是阻止此类攻击，并确保持续监听设备不会无意中听到任何不应该听到的内容。 该项目采取了一种通用的方法来解决任何声学传感系统的偷听问题。将开发一种可编程的声学过滤器，在音频信号进入不可信的声学传感系统之前，该过滤器将检查并过滤掉用户定义的声音。为了实现这一目标，该项目分为四个研究任务：（a）设计算法来分离资源受限的嵌入式平台上的大量声源;（B）设计算法来实时计算活动源的数量;（c）开发需要很少训练数据的声音识别算法;以及（d）开发定制的、低功耗的微型嵌入式系统。 保护隐私的移动的健康应用程序对于将个性化和低成本的医疗保健带给他们可以信任的大众非常重要。该系统将部署在两个基于音频的移动的健康应用中：哮喘和睡眠监测，其中隐私是至关重要的。本项目开发的硬件和软件材料将用于北卡罗来纳州和哥伦比亚大学的研究生和本科生课程。该奖项将资助一名女研究生。研究成果将在外联活动中以及通过在线课程和会议出版物展示。嵌入式系统的分析数据集、算法、代码和设计将通过网站（https：//overhearing.web.unc.edu/）与研究界分享。该网站托管在位于查佩尔山的北卡罗来纳州大学。该存储库将向公众开放，并将在整个3年项目期间不断更新。这个奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

PAMS: Improving Privacy in Audio-Based Mobile Systems

• DOI: 10.1145/3417313.3429383
• 发表时间: 2020-11
• 期刊: Proceedings of the 2nd International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things
• 作者: S. Xia;Xiaofan Jiang

QID: Robust Mobile Device Recognition via a Multi-Coil Qi-Wireless Charging System

• DOI: 10.1145/3498904
• 发表时间: 2022-03
• 期刊: ACM Transactions on Internet of Things
• 作者: Deliang Yang;Guoliang Xing;Jun Huang;Xiangmao Chang;Xiaofan Jiang

SPIDERS: Low-Cost Wireless Glasses for Continuous In-Situ Bio-Signal Acquisition and Emotion Recognition

• DOI: 10.1109/iotdi49375.2020.00011
• 发表时间: 2020-04
• 期刊: 2020 IEEE/ACM Fifth International Conference on Internet-of-Things Design and Implementation (IoTDI)
• 作者: Jingping Nie;Yigong Hu;Yuanyuting Wang;S. Xia;Xiaofan Jiang

aiMSE: Toward an AI-Based Online Mental Status Examination

aiMSE：迈向基于人工智能的在线心理状态检查

• DOI: 10.1109/mprv.2022.3172419
• 发表时间: 2022
• 期刊: IEEE Pervasive Computing
• 影响因子: 1.6
• 作者: Liu, Yanchen;Xia, Stephen;Nie, Jingping;Wei, Peter;Shu, Zhan;Chang, Jeffrey Andrew;Jiang, Xiaofan
• 通讯作者: Jiang, Xiaofan

City-scale vehicle tracking and traffic flow estimation using low frame-rate traffic cameras

• DOI: 10.1145/3341162.3349336
• 发表时间: 2019-09
• 期刊: Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers
• 作者: Peter Wei;Haocong Shi;Jiaying Yang;J. Qian;Yinan Ji;Xiaofan Jiang