Sound, Image and the Brain: Cognitive Live-Arts Technology in Contemporary Game-Oriented and Accessibility Paradigms.

由于当代消费者硬件和软件的成本不断降低和效率不断提高，先进的视听技术现在是司空见惯的，甚至在移动的电信设备中也是如此。精心设计的产品和服务，如上网本和iPhone，体现了当代技术文化的现代转型，不仅提供了新技术，更重要的是，提供了新的经济和社会基础设施，使我们能够参与视听体验和其他体验。这些设备继续为我们感知日常生活的方式提供新的机遇和挑战，通过高速和越来越直观的方式向我们提供信息，增强我们对周围世界的理解。这在一定程度上是由于人机界面研究的发展而实现的。到目前为止，对于大规模生产来说过于昂贵或过于复杂的接口技术正在被原型化并作为新消费设备的一部分部署。这些设备中有触摸屏或“表面”界面（其中iPhone是关键的例子），基于微型摄像头/投影的系统，部署计算机视觉和机器听力，如微软的项目纳塔尔和麻省理工学院的第六感，以及消费级脑机接口，如智能系统Epoch和Neurosky的Minnesota脑电图仪设备。这些发展吸引了公众的想象力，延续了人类技术延伸的叙事。研究人员正在探索界面技术的新方向，通过“增强现实”和“第六感技术”等术语来支持这种扩展。重要的是，这场革命还带来了技术的能力，以改善那些日常生活体验与大多数人截然不同的人的生活，以一种有趣和高度丰富的方式增强感官体验和能力。最重要的是，与那些感官体验不同和/或独特的人合作，不仅不会限制这些技术应用的潜在传播途径，而且会继续为这些方法的完善增加巨大的价值和影响，使在不太常见的情况下吸取的经验教训能够应用于更一般的情况，反之亦然。例如，脑机接口技术对行动不便、认知障碍或其他形式残疾的人具有巨大的潜在价值，其在这些环境中的使用将继续揭示其普遍适用的程度，通过多学科方法，借鉴感知和认知、媒体工程、治疗、互动游戏、声音、音乐和视听艺术，该提案旨在将脑机接口，视听，参与和游戏方面的研究成果，与行业和公共组织合作开发，以便通过与公共部门内的人员更充分地接触，充分发挥其在社会和经济影响方面的潜力，并且还有助于创造和增强用于脑机接口和技术引导的创造力的消费级实时交互硬件和软件。

As a result of the ever-decreasing cost and increasing efficiency of contemporary consumer hardware and software, advanced audiovisual technologies are now commonplace, even in mobile telecommunications devices. Carefully designed products and services, such as the Netbook and the iPhone, exemplify modern transformations in the contemporary technoculture, providing not just new technology, but more importantly, new economic and social infrastructures by which we engage with audiovisual experience and beyond. These devices continue to offer fresh opportunities for and challenges to the way we perceive our everyday life, augmenting our understanding of the world around us, by delivering information to us at high speeds, and in increasingly intuitive ways. This is to some extent enabled by developments in human computer interface research. Interface technologies that until now have been too expensive or too complex for mass production are being prototyped and deployed as part of new consumer devices. Amongst these devices are touch screen or 'surface' interfaces (of which the iPhone is the key example), miniature camera / projection based systems that deploy computer vision and machine listening, such as Microsoft's project Natal and MIT's Sixth Sense, and consumer grade brain-computer interfaces, such as Emotiv systems Epoch, and Neurosky's Mindset Electroencephalograph device.These developments have captured the imagination of the public, perpetuating a narrative of the technological extension of humanity. Researchers exploring new directions for interface technology support this extension through terminology such as 'augmented reality' and 'sixth sense technology'. Importantly, what this revolution also brings is the capacity for technology to enhance the lives of those whose experience of everyday life is very different to that of the majority, augmenting sensory experience and capacity in an interesting and highly fertile way. Most significantly, rather than restricting the potential dissemination routes for the application of these technologies, collaboration with those whose sensory experience is different and/or unique continues to add huge value and impact to the refinement of these approaches, allowing lessons learned in less common situations to be deployed in more general scenarios, and vice versa. For example, brain-computer interface technology is of great potential value to those with limited mobility, cognitive impairment or other form of disability, and its use in these environments will continue to reveal the extent to which it is becoming generally applicable.Through a multidisciplinary approach that draws on perception and cognition, media engineering, therapy, interactive gaming, sound, music and audiovisual arts, this proposal aims to take completed research in brain-computer interfaces, audio-visualisation, participation and gaming, and develop it in partnership with industry and public organisations in order that it might reach its full potential in terms of social and economic impact, by engaging more fully with those within the public sector who both stand to benefit from, and also contribute to the creation and enhancement of consumer-grade real-time interaction hardware and software for brain-computer interfacing and technology-led creativity.