Distant interaction applied to augmented physical objects with and without augmented reality

我们研究的目的是通过理解用户如何同时执行多个手势来增强人机交互。我们采取了两种方法：第一种方法集中于同时执行两个手势的低级数学分析，第二种方法集中于这种手势组合的高级交互能力，对于第一种方法，适于多个手势的数学预测模型的推导仍在进行中。对于第二种方法，我们改进了我们的设计框架，将联合收割机与增强的物理环境进行交互。为了预测未来的模态组合，我们研究了凝视模态如何用于在移动的设备上捕获和传输信息。 我们已经显示出新颖的和显着更好的结果比以前的工作在这方面。最后，我们也分析了智能手机上的拇指输入交互，我们未来的研究计划是集中在手势组合的数学预测模型。这项工作将为新的交互技术开辟几条研究途径。我们计划开始探索使用凝视和手或手指输入的组合。

The purpose of our research is to enhance human-computer interaction via the understanding of how users perform multiple gestures at the same time. We adopted two approaches: the first one focuses on the low-level mathematical analysis of the execution of two gestures at the same time, the second one focuses on the high-level interaction capabilities of such gesture combinations.For the first approach, the derivation of a mathematical predictive model adapted to multiple gestures is still in progress. For the second approach, we refined our design framework to combine two-handed gestures to interact with augmented physical environments. To anticipate future modality combinations, we studied how the gaze modality could be used for capturing but also transmitting information on mobile devices. We have shown novel and significantly better results than that in previous work in this area. Lastly, we also analyzed thumb-input interaction on smartphones.Our plan for future research is to focus on the mathematical predictive model of gesture combinations. This work will then open several research avenues for novel interaction techniques. We plan to start exploring combinations using gaze and hand or finger inputs.