StEP(3D): a standardized evaluation plan for three-dimensional interaction techniques
StEP(3D): a standardized evaluation plan for three-dimensional interaction techniques
复制标题
StEP(3D)：三维交互技术标准化评估计划
DOI：
--
复制
发表时间：
1995
期刊：
影响因子：
--
通讯作者：
G. Perlman
中科院分区：
文献类型：
--
作者：
Scott Grissom;G. Perlman
摘要 可用性评估是软件开发的重要组成部分。然而，制定有效且可靠的评估计划所需的技能可能会阻止某些组织执行可用性评估。这些组织将受益于拥有专为满足其需求而设计的评估计划。标准化评估计划 (StEP) 旨在评估或比较共享某些功能的各种系统。 StEP 是由可用性专家针对特定领域开发的。这些计划可供经验或设施有限的评估人员使用，因为使用 StEP 所需的技能并不像开发 STEP 所需的技能那么严格。已经提出了一些技术来使三维界面更加灵活并且对用户更敏感，但是这些技术的可用性通常没有经过经验评估。 StEP(3D)是一种针对三维交互技术可用性的标准化评估计划，它将基于性能的评估与用户满意度调查问卷相结合。它的设计足够便携且简单，评估人员无需特殊设备或经验即可对三维交互技术进行比较。它评估交互技术用于执行快速且不受约束的三维操作的可用性。两个实证实验证明了 StEP(3D) 的可靠性和有效性。实验 1 显示 StEP(3D) 适合在总结性评估期间比较不同硬件平台上的技术。实验 2 显示 StEP(3D) 足够灵敏，可以在形成性设计期间检测界面的细微变化。我们根据收集的数据和 StEP(3D) 开发经验提出开发 StEP 的建议。然而，这些建议并不限于三维交互技术。大多数建议适用于任何领域的 StEP 开发，并解决可移植性、参与者选择、实验协议和程序以及可用性措施等问题。为特定领域和目的设计的 StEP 集合将提供可重复使用的评估计划库。这种可重用的可用性评估方法应该会降低评估成本，因为组织能够利用以前设计的计划。同时，这种方法应该提高可用性评估的质量，因为 StEP 是由可用性专家开发和验证的。
Abstract Usability evaluation is a critical component of software development. However, skills necessary to develop a valid and reliable evaluation plan may deter some organizations from performing usability evaluations. These organizations would benefit by having an evaluation plan available to them that was already designed for their needs. A standardized evaluation plan (StEP) is designed to evaluate or compare a wide variety of systems that share certain capabilities. StEPs are developed for a specific domain by usability specialists. These plans can then be used by evaluators with limited experience or facilities because the skills necessary to use a StEP are not as demanding as the skills needed to develop a STEP. Techniques have been proposed to make three-dimensional interfaces more flexible and responsive to the user but the usability of these techniques have generally not been evaluated empirically. StEP(3D), a standardized evaluation plan for the usability of three-dimensional interaction techniques, combines performance-based evaluation with a user satisfaction questionnaire. It is designed to be portable and simple enough that evaluators can make comparisons of three-dimensional interaction techniques without special equipment or experience. It evaluates the usability of interaction techniques for performing quick and unconstrained three-dimensional manipulations. Two empirical experiments are reported that demonstrate the reliability and validity of StEP(3D). Experiment 1 shows StEP(3D) is appropriate for comparing techniques on different hardware platforms during summative evaluations. Experiment 2 shows StEP(3D) is sensitive enough to detect subtle changes in an interface during formative design. We make recommendations for developing StEPs based on data we collected and on our experiences with the development of StEP(3D). However, the recommendations are not limited to three-dimensional interaction techniques. Most of the recommendations apply to the development of StEPs in any domain and address issues such as portability, participant selection, experiment protocol and procedures, and usability measures. A collection of StEPs designed for particular domains and purposes would provide a library of reusable evaluation plans. This reusable approach to usability evaluation should reduce the cost of evaluations because organizations are able to take advantage of previously designed plans. At the same time, this approach should improve the quality of usability evaluations because StEPs are developed and validated by usability specialists.