Towards Socially Acceptable Food Type Recognition
Towards Socially Acceptable Food Type Recognition
复制标题
DOI：
10.1109/msn57253.2022.00110
复制
发表时间：
2022-12
期刊：
影响因子：
--
通讯作者：
Junjie Wang;Jiexiong Guan;Y.Alicia Hong;†. HongXue;Shuangquan Wang;Zhenming Liu;Bin Ren;Gang Zhou;William Mary
中科院分区：
文献类型：
--
作者：
Junjie Wang;Jiexiong Guan;Y.Alicia Hong;†. HongXue;Shuangquan Wang;Zhenming Liu;Bin Ren;Gang Zhou;William Mary
食物类型的自动识别是饮食监测的一项重要任务。它可以帮助医疗专业人员识别用户的食物内容，估计能量摄入量，并设计个性化的干预模型，以预防许多慢性疾病，如肥胖和心脏病。各种可穿戴和移动的设备被用作食物类型识别的平台。然而，它们中没有一种在我们的日常生活中得到广泛的应用，同时，社会上也接受了足够的连续佩戴。在本文中，我们提出了一种食物类型识别方法，该方法利用苹果设计的一对广泛使用的无线入耳式耳机Airpods Pro来识别20种不同类型的食物。据我们所知，我们是第一个使用这种社会认可的商业产品来识别食物类型的。音频和运动传感器数据从Airpods Pro收集。然后提取并选择135个代表性特征，使用lightGBM算法构建识别模型。一个真实世界的数据收集进行全面评估所提出的方法为七个人类受试者的性能。结果显示，十重交叉验证测试的平均f1分数达到94.4%，自我评价测试的平均f1分数达到96.0%。
Automatic food type recognition is an essential task of dietary monitoring. It helps medical professionals recognize a user's food contents, estimate the amount of energy intake, and design a personalized intervention model to prevent many chronic diseases, such as obesity and heart disease. Various wearable and mobile devices are utilized as platforms for food type recognition. However, none of them has been widely used in our daily lives and, at the same time, socially acceptable enough for continuous wear. In this paper, we propose a food type recognition method that takes advantage of Airpods Pro, a pair of widely used wireless in-ear headphones designed by Apple, to recognize 20 different types of food. As far as we know, we are the first to use this socially acceptable commercial product to recognize food types. Audio and motion sensor data are collected from Airpods Pro. Then 135 representative features are extracted and selected to construct the recognition model using the lightGBM algorithm. A real-world data collection is conducted to comprehensively evaluate the performance of the proposed method for seven human subjects. The results show that the average f1-score reaches 94.4% for the ten-fold cross-validation test and 96.0% for the self-evaluation test.