Artistic Group Performance as a Model for Novel Collaborative Multimodal Human-Computer Interfaces

本项目开发新的人机界面，基于人类在音乐合奏表演中的交互方式来控制知识传播，旨在开拓新的计算机界面，使我们能够通过手势控制与电子内容交互。该项目假设创造性的艺术设计和使用基于传感器的人类输入到计算环境中是定义下一代研究和教学工具的关键因素，并通过实验探索使用创造性的设计过程。该项目利用了一个独特的虚拟仿真和设计环境，UCSB Allosphere，一个球形的三层多模态沉浸式可视化/超声设备。Allosphere代表了下一代的协作沉浸式环境，对于基于创造性输入的新型界面隐喻的原型设计，其独特的模拟能力将被证明是无价的。目标是开发下一代？音乐ensemblestyle吗?用户界面用于控制艺术表演，交互式科学探索和大型电子舞台上的教学体验，例如选择全圆顶天文馆。预计这将对电子教室的教学作出重大贡献，这些教室的墙壁将被大型互动显示器覆盖。

This project develops new human-computer interfaces for controlling knowledge dissemination based on the way that humans interact in a musical ensemble performance, aiming to pioneer new computer interfaces that will allow us to interact with electronic content through gestural control. The project postulates that creative artistic design and use of sensor-based human input to a computing environment is a key element in defining next-generation research and teaching tools, and uses a creative design process through experimental exploration. The project leverages the availability of a unique virtual simulation and design environment, the UCSB Allosphere, a spherical, three-story multi-modal immersive visualization/sonification device. The Allosphere represents the next generation of collaborative immersive environments, and for prototyping novel interface metaphors based on creative input, its unique simulation capabilities will prove invaluable. The goal is to develop next-generation ?musical ensemblestyle? user interfaces for controlling artistic performances, interactive scientific explorations, and instructional experiences on large electronic stages, such as select full-dome planetaria. It is anticipated that this willlead to major contributions for teaching in electronic classrooms, in which the walls will be covered by large-scale interactive displays.