User Interaction with self-supporting free-form physical objects

用户与自支撑自由形式物理对象的交互

• 批准号: EP/N014197/1
• 负责人: Sriram Subramanian
• 金额: $ 130.41万
• 依托单位: University of Sussex
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2016
• 资助国家: 英国
• 起止时间: 2016 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FN014197%2F1
• 关键词: User; Interaction; self; supporting; free

The primary goal of this project is enhance human-computer interaction by dynamically creating and manipulating physical shapes by levitating and moving a large collections of lightweight 3D objects using principles of acoustic levitation. The proposed idea is illustrated in Figure 1 where one ultrasound transducers is placed as a floor mat and a large collection of polystyrene beads create the shape of a dog that can wag its tail. This will enable us to represent complex datasets in a physical form and allow users to dynamically manipulate it. We are now moving away from traditional human-computer interaction techniques like buttons, keyboards and mice to touch (e.g., Smartphones and multi-touch gestures) and touchless interactions (as with the Kinect and Leap Motion controllers). The limiting factor in these new forms of interactions is, ironically, the lack of any physicality and lack of any co-located feedback. One has no controller or interface element to physically touch and interact with and the visual feedback that may be available is disconnected from the location of the gesture.In our vision, the computer will control the existence, form, and appearance of complex levitating objects composed of "levitating atoms". Users can reach into the levitating matter, feel it, manipulate it, and hear how they deform it with all feedback originating from the levitating object's position in mid-air, as it would with objects in real life. This will change how people use technology as they can interact with technology in the same way they would with real objects in their natural environment.We see many possible benefits of physicalisations for the individual and society: they make data more accessible by leveraging our perceptual exploration skills via active perception, depth perception, non-visual senses, and intermodal perception; give novel exploration possibilities to the visually impaired; support learning via cognitive benefits of direct manipulation of physical artefacts; bring data to the real world for communication and exhibition and; and finally act as tools for engaging audiences with information.

该项目的主要目标是通过利用声悬浮原理悬浮和移动大量轻量级 3D 对象来动态创建和操纵物理形状，从而增强人机交互。所提出的想法如图 1 所示，其中一个超声波换能器被放置为地垫，大量聚苯乙烯珠形成了一只可以摇尾巴的狗的形状。这将使我们能够以物理形式表示复杂的数据集，并允许用户动态地操作它。我们现在正在从按钮、键盘和鼠标等传统人机交互技术转向触摸（例如智能手机和多点触摸手势）和非接触式交互（如 Kinect 和 Leap Motion 控制器）。具有讽刺意味的是，这些新形式的互动的限制因素是缺乏任何物理性和任何同地反馈。人们没有控制器或界面元素来进行物理触摸和交互，并且可能提供的视觉反馈与手势的位置无关。在我们的愿景中，计算机将控制由“悬浮原子”组成的复杂悬浮物体的存在、形式和外观。用户可以接触到悬浮物质，感受它、操纵它，并通过来自悬浮物体在半空中的位置的所有反馈来听到它们如何变形它，就像现实生活中的物体一样。这将改变人们使用技术的方式，因为他们可以像与自然环境中的真实物体交互一样与技术交互。我们看到物理化对个人和社会的许多可能的好处：它们通过主动感知、深度感知、非视觉感知和多式联运感知利用我们的感知探索技能，使数据更容易获取；为视障人士提供新颖的探索可能性；通过直接操作物理制品的认知益处来支持学习；将数据带入现实世界进行交流和展示；最终成为吸引受众了解信息的工具。

项目成果

Project Telepathy

心灵感应计划

• DOI: 10.1145/3027063.3053129
• 发表时间: 2017
• 作者: Bourland A

Enhancing dynamic positioning performance inside mid-air acoustic levitator

增强空中声悬浮器内的动态定位性能

• DOI: 10.1121/1.5101293
• 发表时间: 2019
• 期刊: The Journal of the Acoustical Society of America
• 作者: Fushimi T

Nonlinear trapping stiffness of mid-air single-axis acoustic levitators

• DOI: 10.1063/1.5034116
• 发表时间: 2018-07-16
• 期刊: APPLIED PHYSICS LETTERS
• 影响因子: 4
• 作者: Fushimi, T.;Hil, T. L.;Drinkwater, B. W.
• 通讯作者: Drinkwater, B. W.

Acoustic levitation for multimodal volumetric display

• DOI: 10.1117/12.2569328
• 发表时间: 2020-08
• 作者: R. Hirayama;D. M. Plasencia;N. Masuda;S. Subramanian

A volumetric display for visual, tactile and audio presentation using acoustic trapping

• DOI: 10.1038/s41586-019-1739-5
• 发表时间: 2019-11-14
• 期刊: NATURE
• 影响因子: 64.8
• 作者: Hirayama, Ryuji;Plasencia, Diego Martinez;Subramanian, Sriram
• 通讯作者: Subramanian, Sriram