Image schema and conceptual metaphor based whole body user interfaces

本研究的重点是探讨意象图式理论和概念隐喻理论在儿童互动环境的全身用户界面设计中的作用。任天堂Wii是全身用户界面的一个例子--该系统感知广泛的基于身体的输入动作，用于系统控制。我将继续我的研究轨迹，调查在全身用户界面的设计中是否可以利用意象图式和概念隐喻来提高可用性和实现有效的推理。 目的有三个连续的研究项目，跨越五年；所有研究都体现了儿童-计算机交互的好处。在第一个项目中，我将研究一种假设，即基于图像示意性动作模式的全身用户界面的输入空间将提高此类系统的可用性。在第二个项目中，我将探索这一假设，即这种方法也将改善与儿童在空间领域中的推理有关的学习结果。在第三个项目中，我将探索这样一个假设，即同时使用意象图式和相关的概念隐喻在抽象领域会有好处。 科学方法科学方法依赖于框架意象图式理论和概念隐喻理论，以便系统地应用于全身用户界面设计。接下来是开发原型用户界面和使用原型系统作为研究工具进行实验室实验研究。该框架提供了基于特定运动认知机制的可测试假设，这些机制影响儿童使用此类系统和进行推理的能力。具体地说，我认为在互动层开发初级图像图式(在生命早期发展起来的)将提供有效的交互，因为它利用了在与日常对象和环境交互时产生的内隐知识，并形成了抽象推理的基础。

FOCUS The focus of this research is on investigating the benefits of applying image schema theory and conceptual metaphor theory in the design of whole body user interfaces for children's interactive environments. Nintendo Wii is an example of a whole body user interface -- the system senses a wide range of body-based input actions that are used for system control. I will continue a trajectory of research in which I investigate if image schemata and conceptual metaphors can be leveraged in the design of whole body user interfaces in order to improve usability and enable effective reasoning. OBJECTIVES There are three sequential research projects spanning five years; all investigating the benefits embodied child-computer interaction. In the first project I will investigate the hypothesis that input spaces for whole body user interfaces that are based on image schematic patterns of action will improve the usability of such systems. In the second project I will explore the hypothesis that this approach will also improve learning outcomes related to children's reasoning in spatial domains. In the third project I will explore the hypothesis that using both image schemata and related conceptual metaphors will have benefits in abstract domains. SCIENTIFIC APPROACH The scientific approach relies on framing image schema theory and conceptual metaphor theory so that it can be applied systematically in whole body user interface designs. This is followed by developing prototypical user interfaces and conducting experimental lab studies using prototype systems as research instruments. The framework provides testable hypotheses based on specific motor-cognitive mechanisms which impact children's ability to use and reason with such systems. Specifically, I propose that exploiting primary image schemata (that develop early in life) in the interaction layer will provide effective interaction because it leverages implicit knowledge which is enacted during interaction with everyday objects and environments, and forms the basis for abstract reasoning.