IoTMosaic: Inferring User Activities from IoT Network Traffic in Smart Homes
IoTMosaic: Inferring User Activities from IoT Network Traffic in Smart Homes
复制标题
DOI：
10.1109/infocom48880.2022.9796908
复制
发表时间：
2022-05
期刊：
影响因子：
--
通讯作者：
Yinxin Wan;Kuai Xu;Feng Wang;G. Xue
中科院分区：
文献类型：
--
作者：
Yinxin Wan;Kuai Xu;Feng Wang;G. Xue
网络物理系统、人工智能和云计算的最新进展推动了物联网（IoT）在智能家居中的广泛部署。由于物联网设备经常与用户和环境直接交互，本文研究了我们是否以及如何探索来自多个异构物联网设备的集体见解，以推断家庭安全监控和辅助生活的用户活动。具体来说，我们开发了一个新系统，即IoTMosaic，首先用不同的物联网设备事件序列来描述不同的用户活动，这些事件序列是根据智能家居网络流量的TCP/IP数据包签名提取的。鉴于由于设备故障或网络和系统延迟变化而导致的物联网设备事件丢失和无序的挑战，IoTMosaic进一步开发了简单而有效的近似匹配算法，以从真实世界的物联网网络流量中识别用户活动。我们对智能家居环境中两个多月的数千次用户活动的实验结果表明，我们提出的算法可以从智能家居中的物联网网络流量中推断出不同的用户活动，其整体准确度，精确度和召回率分别为0.99，0.99和1.00。
Recent advances in cyber-physical systems, artificial intelligence, and cloud computing have driven the wide deployment of Internet-of-things (IoT) in smart homes. As IoT devices often directly interact with the users and environments, this paper studies if and how we could explore the collective insights from multiple heterogeneous IoT devices to infer user activities for home safety monitoring and assisted living. Specifically, we develop a new system, namely IoTMosaic, to first profile diverse user activities with distinct IoT device event sequences, which are extracted from smart home network traffic based on their TCP/IP data packet signatures. Given the challenges of missing and out-of-order IoT device events due to device malfunctions or varying network and system latencies, IoTMosaic further develops simple yet effective approximate matching algorithms to identify user activities from real-world IoT network traffic. Our experimental results on thousands of user activities in the smart home environment over two months show that our proposed algorithms can infer different user activities from IoT network traffic in smart homes with the overall accuracy, precision, and recall of 0.99, 0.99, and 1.00, respectively.