The significance of a usability evaluation of an emerging laboratory order entry system
The significance of a usability evaluation of an emerging laboratory order entry system
复制标题
DOI：
10.1016/j.ijmedinf.2006.06.003
复制
发表时间：
2007-02-01
影响因子：
4.9
通讯作者：
Jaspers, Monique W. M.
中科院分区：
文献类型：
--
作者：
Peute, Linda W. P.;Jaspers, Monique W. M.
目的：评估新兴的POE系统OM/Lab在计算机支持的实验室检查排序中的可用性。我们更感兴趣的是在用户测试会话中检测到的可用性问题的关系与秩序行为的效率和错误ordering.Methods：一个认知演练的OM/实验室系统进行了两个分析师使用四个现实生活中的情况下订购实验室测试，这是由一个专家临床医生全面审查。此后，在测试会话中对OM/Lab系统的可用性进行了评价，系统的七个潜在最终用户执行了这四个相同的场景。这些最终用户测试会议的结果被用来分析的可用性缺陷的质量订购的遗漏，错误的订单和cancelled orders.Results的影响：分析显示，共有33个可用性问题，其中25个问题都揭示了认知演练和最终用户会话。这25个可用性问题确实导致了低效的订单行为，遗漏和错误的订单，甚至取消orders.Discussion：我们的研究结果显示，OM/实验室系统遭受了大量的可用性缺陷。界面设计缺陷与屏幕上按钮的错误分配、按钮标签的不可理解性以及反馈中没有向用户提供有关错误原因和用户操作后果的相关信息等有关。此外，我们的用户测试会话结果表明，OM/实验室系统也遭受了更多的社会技术性质的用户交互问题。这些会议显示，除其他外，在OM/Lab系统的订购模式中执行的更具体的行动顺序与最终用户的日常工作程序不一致，并且组群中的实验室测试分组与纸质订购表不匹配。这些可用性缺陷对订购质量和试点实施期间工作流程效率低下的看似负面影响最终导致OM/Lab系统退出临床实践。虽然系统实现失败，我们的可用性研究带来了研究（重新）设计和评估临床计算机应用程序在我们的机构中处于更高的地位。现在人们认识到，支持良好临床实践质量的可用性评价研究非常重要。(c)2006爱思唯尔爱尔兰有限公司保留所有权利。
Objectives: To assess the usability of an emerging POE system, OM/Lab, for the computer-supported ordering of laboratory tests. We were more specifically interested in the relation of the usability problems detected in the user testing sessions with the order behaviour in terms of efficiency and errors in ordering.Methods: A cognitive walkthrough of the OM/Lab system was conducted by two analysts using four real-life scenarios for ordering laboratory tests, which were reviewed for comprehensiveness by an expert clinician. Thereafter, the OM/Lab system was evaluated on its usability in testing sessions with seven potential end-users of the system performing these same four scenarios. The results of these end-user testing sessions were used to analyze the effect of usability flaws on the quality of ordering in terms of omissions, errors in orders and cancelled orders.Results: The analyses revealed a total of 33 usability problems, of which 25 problems were revealed both by the cognitive walkthrough and in the end-user sessions. These 25 usability problems indeed led to inefficient order behaviour, omissions and errors in orders and even to cancelled orders.Discussion: Our results revealed that the OM/Lab system suffered from a high number of usability flaws. The interface design flaws were, among other things, related to misallocation of buttons on the screen, incomprehensibility of button labels and feedback containing no relevant information to the user about the cause of errors made and consequences of a user's action. Additionally, our user test session results indicated that the OM/Lab system also suffered from user interaction problems of a more socio-technical nature. These sessions revealed, among other things, that the more specific action sequences to be executed within the ordering model of the OM/Lab system did not correspond to the daily working routines of end-users and that the grouping of laboratory tests within clusters did not match the paper-based order forms. The seemingly negative effects of these usability flaws on the quality of ordering and the inefficiency of work processes during the pilot implementation finally lead to withdrawal of the OM/Lab system from clinical practice. Though the system implementation failed, our usability study brought research on (re)designing and evaluating clinical computer applications at a higher status in our institution. It is now recognized that usability evaluation studies that will support good quality of clinical practice are highly important. (c) 2006 Elsevier Ireland Ltd. All rights reserved.