Sound, Image and the Brain: Cognitive Live-Arts Technology in Contemporary Game-Oriented and Accessibility Paradigms.

由于当代消费者硬件和软件的成本不断下降和效率不断提高，先进的视听技术现在已经司空见惯，甚至在移动电信设备中也是如此。精心设计的产品和服务，如上网本和iPhone，体现了当代科技文化的现代变革，不仅提供了新技术，更重要的是提供了新的经济和社会基础设施，我们通过这些基础设施参与到视听体验和其他方面。这些设备继续为我们感知日常生活的方式提供新的机会和挑战，通过高速和越来越直观的方式向我们传递信息，增强我们对周围世界的理解。这在一定程度上是由于人机界面研究的发展。到目前为止，对于大规模生产来说，接口技术过于昂贵或过于复杂，现在正在进行原型制作，并作为新的消费设备的一部分进行部署。在这些设备中，有触摸屏或表面界面(苹果手机就是其中的关键例子)，基于微型相机/投影的运用计算机视觉和机器听力的系统，如微软的Natal和麻省理工学院的Sixth Sense，以及消费级脑机接口，如Emotiv Systems Epoch和Neurosky的思维定势脑电图仪设备。这些发展抓住了公众的想象力，永久地讲述了人类技术的延伸。探索界面技术新方向的研究人员通过“增强现实”和“第六感技术”等术语支持这一扩展。重要的是，这场革命还带来了一种能力，即技术能够改善那些日常生活体验与大多数人截然不同的人的生活，以一种有趣和高度丰富的方式增强感官体验和能力。最重要的是，与那些感觉体验不同和/或独特的人合作，不是限制这些技术应用的潜在传播途径，而是继续为改进这些方法增加巨大的价值和影响，使在不太常见的情况下吸取的经验教训能够在更一般的情况下使用，反之亦然。例如，脑机接口技术对行动不便、认知障碍或其他形式的残疾人士具有巨大的潜在价值，它在这些环境中的使用将继续揭示它变得普遍适用的程度。通过利用感知和认知、媒体工程、治疗、互动游戏、声音、音乐和视听艺术的多学科方法，这项建议旨在完成对脑机接口、视听、参与和游戏的研究，并与行业和公共组织合作开发，以充分发挥其在社会和经济影响方面的潜力，通过更充分地与公共部门中的那些人接触，这些人将受益于并有助于创造和加强消费级实时交互硬件和软件，以实现脑机接口和技术引领的创造力。

As a result of the ever-decreasing cost and increasing efficiency of contemporary consumer hardware and software, advanced audiovisual technologies are now commonplace, even in mobile telecommunications devices. Carefully designed products and services, such as the Netbook and the iPhone, exemplify modern transformations in the contemporary technoculture, providing not just new technology, but more importantly, new economic and social infrastructures by which we engage with audiovisual experience and beyond. These devices continue to offer fresh opportunities for and challenges to the way we perceive our everyday life, augmenting our understanding of the world around us, by delivering information to us at high speeds, and in increasingly intuitive ways. This is to some extent enabled by developments in human computer interface research. Interface technologies that until now have been too expensive or too complex for mass production are being prototyped and deployed as part of new consumer devices. Amongst these devices are touch screen or 'surface' interfaces (of which the iPhone is the key example), miniature camera / projection based systems that deploy computer vision and machine listening, such as Microsoft's project Natal and MIT's Sixth Sense, and consumer grade brain-computer interfaces, such as Emotiv systems Epoch, and Neurosky's Mindset Electroencephalograph device.These developments have captured the imagination of the public, perpetuating a narrative of the technological extension of humanity. Researchers exploring new directions for interface technology support this extension through terminology such as 'augmented reality' and 'sixth sense technology'. Importantly, what this revolution also brings is the capacity for technology to enhance the lives of those whose experience of everyday life is very different to that of the majority, augmenting sensory experience and capacity in an interesting and highly fertile way. Most significantly, rather than restricting the potential dissemination routes for the application of these technologies, collaboration with those whose sensory experience is different and/or unique continues to add huge value and impact to the refinement of these approaches, allowing lessons learned in less common situations to be deployed in more general scenarios, and vice versa. For example, brain-computer interface technology is of great potential value to those with limited mobility, cognitive impairment or other form of disability, and its use in these environments will continue to reveal the extent to which it is becoming generally applicable.Through a multidisciplinary approach that draws on perception and cognition, media engineering, therapy, interactive gaming, sound, music and audiovisual arts, this proposal aims to take completed research in brain-computer interfaces, audio-visualisation, participation and gaming, and develop it in partnership with industry and public organisations in order that it might reach its full potential in terms of social and economic impact, by engaging more fully with those within the public sector who both stand to benefit from, and also contribute to the creation and enhancement of consumer-grade real-time interaction hardware and software for brain-computer interfacing and technology-led creativity.