Intuitive Interaction Method using Mobile Devices

本研究的目的是寻找一种使用移动设备进行直观交互的方法。为此，本研究旨在寻找现实世界中便携式信息终端(PIT)的输入动作与3D信息空间中的操作之间的合适映射，通过实验发现，每个原始操作分别映射到一些动作。然而，对于3D环境中的实际操作，多个基元操作是同时进行的。此外，由于用户在移动或旋转对象之前必须选择对象，因此移动或旋转操作必须在选择操作之后进行。也就是说，用于选择的输入动作取决于用于移动或旋转的输入动作。考虑到这种并发性和依赖性，3D信息空间中的操作与现实世界中的动作之间的适当映射如下；(1)通过改变凹坑位置改变观察位置；(2)通过改变凹坑方向改变观察方向；(3)通过拾取或抓取对象并移动手来选择和移动对象；(4)通过拾取或握住对象并旋转手来选择和旋转对象。但是，为了将对象移动到较远的地方，由于用户需要广泛地移动移动设备或他/她的手，导致用户身体疲劳或降低任务性能。为了克服这一问题，本研究还提出了一种基于投掷手势的物体移动方法--投掷法。使用该方法，用户不仅可以投掷物体，还可以随心所欲地调整运动物体的方向。通过实验发现，该方法可以减少用户的体力疲劳，并有可能提高任务绩效。

The aim of this research is to find out an intuitive interaction method using mobile devices. For that purpose, this research focuses on finding the suitable mapping between the input action with the portable information terminal (PIT) in the real world and the operation in the 3D information space.From the experiments, it was found that each primitive operation was mapped to some actions respectively. However, for practical operation in the 3D environment, multiple primitive operations are done concurrently. Furthermore, because users must select the object before move or rotate it, moving or rotating operation must follow the selecting operation. That is, the input action for selecting depends on the input action for moving or rotating. With taking into account of this concurrency and dependence, the suitable mapping between the operations in the 3D information space and the actions in the real world are followings; (1) changing the view position with changing PIT position, (2) changing the view orientation with changing PIT orientation, (3) selecting and moving the object with picking or grasping the object and moving the hand, and (4) selecting and rotating the object with picking or grasping the object and rotating the hand.However, in order to move the object far away, it caused a physical fatigue to the user or decreased the task performance because he/she should move the mobile device or his/her hand widely. To overcome this problem, the object moving method with throwing gesture, named as "throwing method", is also proposed in this research. With the proposed method, users can not only throw the object but also adjust the direction of the moving object as they want. From the experiment, it is found that the proposed method reduces the physical fatigue of the user and might be possible to increase the task performance.