Ergonomic multimedia

根据国际人体工效学协会的定义，人类工效学是一门相关的科学学科 这个研究项目的主要主题是人体工学多媒体。更具体地说，我们的目标是从人类的角度开发多媒体处理工具和技术。 多媒体无处不在，用户似乎永远也听不够。设备处理和呈现多媒体的能力已成为消费电子行业的一个主要卖点和关键差异化因素，苹果近年来的产品就证明了这一点。在过去的几十年里，有关多媒体的主要挑战是通信--如何将其传递给用户？虽然这仍然是一个挑战，但新的问题开始出现。即使在今天，特别是在未来，与多媒体有关的主要问题不仅是如何将其提供给用户，而且还将如何使其适合用户？如何让它更吸引人，更容易使用？ 复杂测量技术的发展，如眼睛和凝视跟踪，正在促进 验证和测试人类注意力、感知、感知和行为的现有模型。论 在提出的研究计划的理论方面，我们计划改进现有的人类互动模型 使用各种媒体类型，并开发新的媒体类型，特别是跨媒体、上下文自适应和设备特定的模型。在实践方面，我们的目标是利用上述模型创建新的高效算法，以以人为中心的方式捕获、处理、编码、通信、呈现和解释多媒体信号，并创建使用户能够以自然和直观的方式与多媒体交互的工具。 这种类型的研究需要一种对心理学有扎实理解和 除了在工程和计算方面的专业知识外，还有认知科学。以我们的经验为基础 多媒体压缩和处理，以及我们最近与人机交互和心理学研究人员的合作，拟议的研究计划旨在为这些研究人员提供培训，并使他们具备必要的技能，以成为这一新兴领域的成功创新者和领导者。

As defined by the International Ergonomics Association, "ergonomics is the scientific discipline concerned with the understanding of interactions among humans and other elements of a system." The main theme of this research program is ergonomic multimedia. More specifically, our goal is to develop tools and techniques for multimedia processing from a human perspective. Multimedia is omnipresent, and the users can't seem to get enough of it. The extent to which a device is able to process and present multimedia has become a major selling point and a key differentiator in the consumer electronics industry, as demonstrated by Apple's products in recent years. In the past few decades, the main challenge regarding multimedia was communication - how to get it to the user? While that continues to be a challenge, new problems are starting to emerge. Even today, and especially in the future, the main question related to multimedia will not only be how to get it to the user, but how to fit it to the user? How to make it more appealing and easier to use? The development of sophisticated measurement techniques, such as eye and gaze tracking, is facilitating verification and testing of existing models of human attention, sensing, perception, and behavior. On the theoretical side of the proposed research program, we plan to improve existing models of human interaction with various media types, and develop new ones, especially cross-media, context-adaptive, and device-specific models. On the practical side, our goal is to utilize the aforementioned models in the creation of new and efficient algorithms for capturing, processing, encoding, communicating, presenting, and interpreting multimedia signals in a human-centric way, and to create tools that enable users to interact with multimedia in a natural and intuitive manner. This type of research requires a new breed of researchers with a solid understanding of psychology and cognitive science in addition to expertise in engineering and computing. Building on our experience in multimedia compression and processing, and our recent collaboration with researchers in HCI and psychology, the proposed research program aims to provide training for such researchers and equip them with necessary skills to become successful innovators and leaders in this emerging field.