RI Medium: Audio Diarization - Towards Comprehensive Description of Audio Events

RI Medium：音频二值化 - 全面描述音频事件

• 批准号: 0803219
• 负责人: Mark Hasegawa-Johnson
• 金额: $ 24.99万
• 依托单位: University of Illinois at Urbana-Champaign
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-09-01 至 2010-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0803219&HistoricalAwards=false
• 关键词: RI; Medium; Audio; Diarization; Towards

?Perceptual salience? is a term used by psychologists of vision to describe the power of an object to draw viewer attention; for example, it has been demonstrated that eye movements target salient objects sooner than less-salient objects, and that salient objects are detected more quickly than less-salient objects. The first sub-goal of this research is to develop automatic measurements of perceptual salience for auditory events, defined here to be a center-surround contrast in terms of amplitude, spectrum, or temporal features such as zero-crossing rate and periodicity. The second sub-goal of this research is to test salience measurements in an audio event detection paradigm, using the 2007 University of Illinois CLEAR evaluation system (Classification and Labeling of Events, Activities and Relationships). The third sub-goal of this research is to compare audio event transcriptions generated by human labelers viewing an audiovisual record of a meeting vs. transcriptions generated by labelers who listen to the audio without watching any accompanying video; the experimental hypothesis states that auditory salience predicts audio-only labels better than it predicts audiovisual labels. This research is designed as a collaboration between experts in computer vision and audio signal processing. If successful, the proposed methods will help to add an audio channel to the video security monitoring systems currently installed in many hospitals, nursing homes, government buildings and industrial sites.

?知觉突显？是视觉心理学家用来描述物体吸引观众注意力的能力的术语;例如，已经证明眼睛运动比不太突出的物体更快地瞄准突出物体，并且突出物体比不太突出的物体更快地被检测到。 本研究的第一个子目标是开发自动测量听觉事件的感知显著性，这里定义为幅度，频谱或时间特征（如过零率和周期性）的中心-环绕对比度。 本研究的第二个子目标是测试的音频事件检测范例中的显着性测量，使用2007年伊利诺伊大学的CLEAR评估系统（事件，活动和关系的分类和标签）。 本研究的第三个子目标是比较音频事件产生的标签观看会议的视听记录与产生的标签谁听音频，而不看任何伴随的视频;实验假设指出，听觉显着性预测音频标签比它预测视听标签。 这项研究是计算机视觉和音频信号处理专家之间的合作。 如果成功，所提出的方法将有助于为目前安装在许多医院、疗养院、政府大楼和工业场所的视频安全监控系统增加一个音频通道。