An interpretable health behavioral intervention policy for mobile device users.
An interpretable health behavioral intervention policy for mobile device users.
复制标题
针对移动设备用户的可解释的健康行为干预政策。
DOI：
10.1147/jrd.2017.2769320
复制
发表时间：
2018
影响因子：
1.3
通讯作者：
Cheung,Y-KK
中科院分区：
文献类型：
--
作者：
Hu,X;Hsueh,P-YS;Chen,C-H;Diaz,KM;Parsons,FE;Ensari,I;Qian,M;Cheung,Y-KK
An increasing number of people use mobile devices to monitor their behavior, such as exercise, and record their health status, such as psychological stress. However, these devices rarely provide ongoing support to help users understand how their behavior contributes to changes in their health status. To address this challenge, we aim to develop an interpretable policy for physical activity recommendations that reduce a user's perceived psychological stress, over a given time horizon. We formulate this problem as a sequential decision-making problem and solve it using a new method that we refer to as threshold Q-learning (TQL). The advantage of the TQL method over traditional Q-learning is that it is “doubly robust” and interpretable. This interpretability is achieved by making model assumptions and incorporating threshold selection into the learning process. Our simulation results indicate that the TQL method performs better than the Q-learning method given model misspecification. Our analyses are performed on data collected from 79 healthy adults over a 7 week period, where the data comprise physical activity patterns collected from mobile devices and self-assessed stress levels of the users. This work serves as a first step toward a computational health coaching solution for mobile device users.
