Classification and prioritization of usability problems using an augmented classification scheme
Classification and prioritization of usability problems using an augmented classification scheme
复制标题
DOI：
10.1016/j.jbi.2011.07.002
复制
发表时间：
2011-12-01
影响因子：
4.5
通讯作者：
Jaspers, M. W. M.
中科院分区：
文献类型：
--
作者：
Khajouei, R.;Peute, L. W. P.;Jaspers, M. W. M.
在医疗保健中，存在各种方法进行可用性评估研究。但是，尽管方法是明确的，没有可用性评估方法提供了一个框架，可用性报告活动是完全标准化的。尽管经常使用表单来报告可用性问题及其上下文信息，但这种报告经常受到信息丢失的阻碍。这是因为评估者的问题描述是基于他们在某个特定时刻对可用性问题的突出性的个人判断。此外，可用性问题通常根据其类型、数量和严重性进行分类。这些类通常由评估者为手头的目的设计，并且使用的问题类型通常并不相互排斥、完整和不同。此外，可用性问题对任务结果的影响通常没有考虑在内。因此，问题的描述往往是模糊的，甚至在与系统设计人员讨论时，在类型或严重程度上与其分类相结合时，也会留下多种解释的空间。这些问题描述的正确解释高度依赖于评估者从记忆中检索相关细节的程度，为了纠正这种情况，需要一个框架来指导可用性评估者对可用性问题进行高质量的报告和独特的分类。这样的框架应该允许披露问题原因的基本本质、严重性评级以及可用性问题对任务结果的影响的分类。用户操作框架（UAF）是一个现有的经过验证的分类框架，允许对可用性问题进行独特的分类，但它不包括严重性评级，也不包含可用性缺陷对最终任务结果的潜在影响的评估。因此，我们根据Nielsen的分类增加了UAF的严重性评级，并增加了一个分类，用于表达可用性问题对最终任务结果的潜在影响。这样一个增强的计划将提供必要的信息，系统开发人员了解可用性问题的本质，优先问题，并在系统重新设计解决他们。为了研究这种增强方案的可行性，将其应用于计算机医嘱输入系统（CPOE）的可用性研究结果，评估者使用增强的UAF对大多数可用性问题进行了相同的分类。此外，它有助于区分看起来相似但影响用户-系统交互和任务结果不同的问题，反之亦然。这项工作是有价值的，不仅为系统开发人员，但也为研究人员谁想要研究其他可用性评估研究的结果，因为该计划使得可用性研究的结果可比，易于检索。(C)2011 Elsevier Inc. All rights reserved.
Various methods exist for conducting usability evaluation studies in health care. But although the methodology is clear, no usability evaluation method provides a framework by which the usability reporting activities are fully standardized. Despite the frequent use of forms to report the usability problems and their context-information, this reporting is often hindered by information losses. This is due to the fact that evaluators' problem descriptions are based on individual judgments of what they find salient about a usability problem at a certain moment in time. Moreover, usability problems are typically classified in terms of their type, number, and severity. These classes are usually devised by the evaluator for the purpose at hand and the used problem types often are not mutually exclusive, complete and distinct. Also the impact of usability problems on the task outcome is usually not taken into account. Consequently, problem descriptions are often vague and even when combined with their classification in type or severity leave room for multiple interpretations when discussed with system designers afterwards. Correct interpretation of these problem descriptions is then highly dependent upon the extent to which the evaluators can retrieve relevant details from memory.To remedy this situation a framework is needed guiding usability evaluators in high quality reporting and unique classification of usability problems. Such a framework should allow the disclosure of the underlying essence of problem causes, the severity rating and the classification of the impact of usability problems on the task outcome. The User Action Framework (UAF) is an existing validated classification framework that allows the unique classification of usability problems, but it does not include a severity rating nor does it contain an assessment of the potential impact of usability flaws on the final task outcomes. We therefore augmented the UAF with a severity rating based on Nielsen's classification and added a classification for expressing the potential impact of usability problems on final task outcomes. Such an augmented scheme will provide the necessary information to system developers to understand the essence of usability problems, to prioritize problems and to tackle them in a system redesign. To investigate the feasibility of such an augmented scheme, it was applied to the results of usability studies of a computerized physician order entry system (CPOE).The evaluators classified the majority of the usability problems identically by use of the augmented UAF. In addition it helped in differentiating problems that looked similar but yet affect the user-system interaction and the task results differently and vice versa. This work is of value not only for system developers but also for researchers who want to study the results of other usability evaluation studies, because this scheme makes the results of usability studies comparable and easily retrievable. (C) 2011 Elsevier Inc. All rights reserved.