Intuitive Interaction Method using Mobile Devices

本研究的目的是寻找一种使用移动设备的直观交互方法。为此，本研究的重点是寻找现实世界中与便携式信息终端（PIT）的输入动作与三维信息空间中的操作之间的合适映射。从实验中发现，每个原语操作分别映射到一些动作。然而，对于3D环境中的实际操作，多个原语操作是并发进行的。此外，由于用户必须在移动或旋转对象之前选择对象，因此移动或旋转操作必须在选择操作之后进行。也就是说，选择的输入动作依赖于移动或旋转的输入动作。考虑到这种并发性和依赖性，三维信息空间中的操作与现实世界中的操作之间的适当映射如下：(1)通过改变PIT位置来改变视图位置，(2)通过改变PIT方向来改变视图方向，(3)通过拾取或抓取物体并移动手来选择和移动物体，(4)通过拾取或抓取物体并旋转手来选择和旋转物体。但是，为了将物体移动到较远的地方，会给使用者造成身体疲劳或降低任务性能，因为他/她需要移动移动设备或他/她的手。为了克服这一问题，本研究还提出了一种带有投掷手势的物体移动方法，称为“投掷法”。使用该方法，用户不仅可以投掷物体，还可以根据自己的需要调整运动物体的方向。实验结果表明，本文提出的方法减少了用户的身体疲劳，有可能提高任务性能。

The aim of this research is to find out an intuitive interaction method using mobile devices. For that purpose, this research focuses on finding the suitable mapping between the input action with the portable information terminal (PIT) in the real world and the operation in the 3D information space.From the experiments, it was found that each primitive operation was mapped to some actions respectively. However, for practical operation in the 3D environment, multiple primitive operations are done concurrently. Furthermore, because users must select the object before move or rotate it, moving or rotating operation must follow the selecting operation. That is, the input action for selecting depends on the input action for moving or rotating. With taking into account of this concurrency and dependence, the suitable mapping between the operations in the 3D information space and the actions in the real world are followings; (1) changing the view position with changing PIT position, (2) changing the view orientation with changing PIT orientation, (3) selecting and moving the object with picking or grasping the object and moving the hand, and (4) selecting and rotating the object with picking or grasping the object and rotating the hand.However, in order to move the object far away, it caused a physical fatigue to the user or decreased the task performance because he/she should move the mobile device or his/her hand widely. To overcome this problem, the object moving method with throwing gesture, named as "throwing method", is also proposed in this research. With the proposed method, users can not only throw the object but also adjust the direction of the moving object as they want. From the experiment, it is found that the proposed method reduces the physical fatigue of the user and might be possible to increase the task performance.