Use of a Mobile App for the Process Evaluation of an Intervention in Health Care: Development and Usability Study.
Use of a Mobile App for the Process Evaluation of an Intervention in Health Care: Development and Usability Study.
复制标题
使用移动应用程序进行医疗保健干预措施的过程评估：开发和可用性研究。
DOI：
10.2196/20739
复制
发表时间：
2021-10-28
影响因子：
2.2
通讯作者：
SHIFT Research Team
中科院分区：
文献类型：
--
作者：
Chin WSY;Kurowski A;Gore R;Chen G;Punnett L;SHIFT Research Team
流程评估通过对运营的持续监控来衡量已实现或未实现结果的背景。移动应用程序是一种可能不太繁重的工具，可以从参与者那里实时收集这些指标。研究驱动的应用程序并不总是在开发时关注其对目标用户的可用性。可用性测试揭示了研究人员、开发人员和用户对于高效、有效和令人满意的产品的心理模型的差距，并促进设计改进。模型可能因用户人口统计数据而异。本研究描述了一款移动应用程序的开发，用于在一项针对医护人员的干预研究中收集流程评估指标，该应用程序使用多个阶段的反馈来完善应用程序设计，根据工作人员对应用程序的总体采用情况和应用程序的特定功能来量化使用情况，并比较最终用户的人口统计和工作特征。开发了一款应用程序来评估新英格兰工作场所健康工作场所参与计划中的健康促进中心，该计划培训团队开发针对劳动力健康障碍的解决方案。劳资健康与安全委员会成员、项目倡导者和经理受邀使用该应用程序。团队协调员可以使用随附的网站。该应用程序的 4 个功能是会议创建、会后调查、项目时间日志和聊天消息。谷歌分析记录了屏幕时间。试点测试的两个阶段评估了不同设备软件、硬件和平台的功能和可用性。在第一阶段，学生测试人员通过执行最终用户期望的任务场景来评估第一个功能原型。反馈用于解决问题并为进一步的开发提供信息。在第二阶段，该应用程序向所有研究参与者提供；志愿者完成任务场景并在部署时提供反馈。根据用户特征对部署后18个月的最终用户数据进行汇总和比较。在第一阶段，功能问题被记录并修复。 7 名学生测试人员的系统可用性量表得分对应于良好的可用性（移动应用=72.9；网站=72.5），而 15 名最终用户将可用性评为“良好”（移动应用=64.7；网站=62.5）。学生测试人员的主要可用性主题是灵活性、效率以及系统状态的可见性；最终用户优先考虑灵活性、效率和识别度，而不是回忆度。学生测试人员和最终用户都提出了有用的功能，这些功能将导致后端的大规模重组；这些是根据其收益与成本来考虑的。在第 2 阶段，超过 18 个月的中位总使用时间为 10.9 分钟（IQR 23.8）和 14.5 次访问（IQR 12.5）。人口统计特征没有观察到使用模式。开发移动应用程序的职业健康研究人员应为早期迭代测试做好预算，以发现并解决问题或可用性问题，这可以增加最终产品的使用并防止潜在的数据差距。
Process evaluation measures the context in which an outcome was or was not achieved through the ongoing monitoring of operations. Mobile apps are a potentially less burdensome tool for collecting these metrics in real time from participants. Research-driven apps are not always developed while paying attention to their usability for target users. Usability testing uncovers gaps in researchers’, developers’, and users’ mental models of what an efficient, effective, and satisfying product looks like and facilitates design improvement. Models may vary by user demographics. This study describes the development of a mobile app for collecting process evaluation metrics in an intervention study with health care workers that uses feedback at multiple stages to refine the app design, quantify usage based on workers' overall adoption of the app and the app's specific function, and compare the demographic and job characteristics of end users. An app was developed to evaluate the Center for Promotion of Health in the New England Workplace Healthy Workplace Participatory Program, which trains teams to develop solutions for workforce health obstacles. Labor-management health and safety committee members, program champions, and managers were invited to use the app. An accompanying website was available for team facilitators. The app’s 4 functions were meeting creation, postmeeting surveys, project time logs, and chat messages. Google Analytics recorded screen time. Two stages of pilot tests assessed functionality and usability across different device software, hardware, and platforms. In stage 1, student testers assessed the first functional prototype by performing task scenarios expected from end users. Feedback was used to fix issues and inform further development. In stage 2, the app was offered to all study participants; volunteers completed task scenarios and provided feedback at deployment. End user data for 18 months after deployment were summarized and compared by user characteristics. In stage 1, functionality problems were documented and fixed. The System Usability Scale scores from 7 student testers corresponded to good usability (mobile app=72.9; website=72.5), whereas 15 end users rated usability as ok (mobile app=64.7; website=62.5). Predominant usability themes from student testers were flexibility and efficiency and visibility of system status; end users prioritized flexibility and efficiency and recognition rather than recall. Both student testers and end users suggested useful features that would have resulted in the large-scale restructuring of the back end; these were considered for their benefits versus cost. In stage 2, the median total use time over 18 months was 10.9 minutes (IQR 23.8) and 14.5 visits (IQR 12.5). There were no observable patterns in use by demographic characteristics. Occupational health researchers developing a mobile app should budget for early and iterative testing to find and fix problems or usability issues, which can increase eventual product use and prevent potential gaps in data.
登录
查看更多内容
影响因子：
5.2
作者：
Muuraiskangas, Salla;Harjumaa, Marja;Ermes, Miikka
通讯作者：
Ermes, Miikka
影响因子：
5
作者：
Goyal, Shivani;Morita, Plinio P.;Cafazzo, Joseph A.
通讯作者：
Cafazzo, Joseph A.
影响因子：
2.2
作者：
Brown M;Hooper N;Eslambolchilar P;John A
通讯作者：
John A
影响因子：
5
作者：
Hilliard ME;Hahn A;Ridge AK;Eakin MN;Riekert KA
通讯作者：
Riekert KA
影响因子：
18.2
作者：
Jaworski, B;Kohli, AK;Sahay, A
通讯作者：
Sahay, A