Alternative sound information display - ASID

替代声音信息显示 - ASID

• 批准号: 337952-2006
• 负责人: Fels, Deborah
• 金额: $ 10.67万
• 依托单位: Ryerson University
• 依托单位国家: 加拿大
• 项目类别: Strategic Projects - Group
• 财政年份: 2007
• 资助国家: 加拿大
• 起止时间: 2007-01-01 至 2008-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=364877
• 关键词: Alternative; sound; information; display; ASID

The goal of this project is to explore mechanisms for creating alternative ways to express sound information so that people who are deaf or hard of hearing (HOH) have more equal access to sound in media. Within television and film, sound acts as a rich source of information reflecting mood, emotion, music, and sound effects, as well as dialogue. For example, people who are deaf will not necessarily realize that music is conventionally used to create tension in horror films or, if this realization is made, it may be incomplete or delayed. In using alternative means through which to communicate sound information, we want to create a parallel entertainment experience for people who are deaf or HOH. Our team seeks to translate/transfer information that is normally heard into that which is felt and/or seenThe results of this project will be an engaging and highly interactive art installation that will introduce audiences with and without disabilities to the concept of expressing emotions using alternative display techniques that combine haptic, graphics, kinetic text and video together. From a scientific perspective, we wil develop a comprehensive model that allows for the semi-automatic interpretation of emotion. The model will produce a mapping of emotion to physical parameters of the alternative displays based on the combination of the creative approach used and known techniques for detecting and categorizing emotion from specific sound sources. Not only will this have an exciting artistic outcome in new media, but also it will have important social benefits, as our model and display techniques can be used to produce more accessible audiovisual material for people who are deaf and HOH.

该项目的目标是探索创建表达声音信息的替代方式的机制，以便耳聋或听力困难的人 (HOH) 能够更平等地获得媒体中的声音。在电视和电影中，声音是反映情绪、情感、音乐、音效以及对话的丰富信息源。例如，聋哑人不一定会意识到音乐通常用于在恐怖电影中制造紧张气氛，或者即使意识到这一点，也可能是不完整或延迟的。在使用替代方式来传达声音信息时，我们希望为失聪者或失聪者创造一种并行的娱乐体验。我们的团队致力于将通常听到的信息转化/传递为感觉到和/或看到的信息。该项目的结果将是一个引人入胜且高度互动的艺术装置，它将向残疾和健康观众介绍使用将触觉、图形、动态文本和视频结合在一起的替代显示技术来表达情感的概念。从科学的角度来看，我们将开发一个全面的模型，可以对情感进行半自动解释。该模型将基于所使用的创造性方法和用于检测和分类来自特定声源的情感的已知技术的组合，生成情感到替代显示器的物理参数的映射。这不仅会在新媒体中产生令人兴奋的艺术成果，而且还会产生重要的社会效益，因为我们的模型和显示技术可用于为聋哑人和 HOH 人士制作更容易理解的视听材料。