Artistic Group Performance as a Model for Novel Collaborative Multimodal Human-Computer Interfaces

该项目开发了基于人类在音乐合奏表演中互动的方式来控制知识传播的新的人机界面，旨在开创新的计算机界面，使我们能够通过手势控制与电子内容进行互动。该项目假定，创造性的艺术设计和使用基于传感器的人类对计算环境的输入是定义下一代研究和教学工具的关键要素，并通过实验探索使用创造性的设计过程。该项目利用了一个独特的虚拟仿真和设计环境UCSB AllSphere，这是一个球形的、三层楼高的多模式沉浸式可视化/发声设备。对于基于创造性输入的新颖界面隐喻的原型制作，其独特的模拟能力将被证明是无可估量的。目标是发展下一代？音乐合奏？用于控制大型电子舞台上的艺术表演、交互式科学探索和教学体验的用户界面，例如选择全圆顶行星。预计这将为电子教室的教学做出重大贡献，电子教室的墙壁上将覆盖着大型互动显示器。

This project develops new human-computer interfaces for controlling knowledge dissemination based on the way that humans interact in a musical ensemble performance, aiming to pioneer new computer interfaces that will allow us to interact with electronic content through gestural control. The project postulates that creative artistic design and use of sensor-based human input to a computing environment is a key element in defining next-generation research and teaching tools, and uses a creative design process through experimental exploration. The project leverages the availability of a unique virtual simulation and design environment, the UCSB Allosphere, a spherical, three-story multi-modal immersive visualization/sonification device. The Allosphere represents the next generation of collaborative immersive environments, and for prototyping novel interface metaphors based on creative input, its unique simulation capabilities will prove invaluable. The goal is to develop next-generation ?musical ensemblestyle? user interfaces for controlling artistic performances, interactive scientific explorations, and instructional experiences on large electronic stages, such as select full-dome planetaria. It is anticipated that this willlead to major contributions for teaching in electronic classrooms, in which the walls will be covered by large-scale interactive displays.