Using sound to extract meaning from complex data

Using sound to extract meaning from complex data
复制标题

使用声音从复杂数据中提取含义

DOI:
--
复制
发表时间:
1991
期刊:
Electronic imaging
影响因子:
--
通讯作者:
Alan B. Craig
Alan B. Craig
中科院分区:
--
文献类型:
--
作者:
Carla A. Scaletti;Alan B. Craig

文献摘要

被引文献

相似文献

在分析抽象数据集时,用几种可供选择的格式来表示它们是有用的,每种格式都可以显示数据的不同方面。虽然大多数数据映射的工作都集中在视觉表示上,但人们发现,声音表示也可以有效地帮助解释复杂的数据,特别是当声音化与可视化结合使用时。作者已经开发了几个高级发音工具的原型,可以应用于各种各样的数据。虽然他们使用可编程多处理器数字信号处理硬件来开发和实验这些原型,但这些工具中的每一个都可以实现为专用硬件或软件,供科学家在特定应用中使用。原型工具包括:映射器(将数据映射到各种声音参数)、比较器(将不同的映射馈送到每个扬声器通道)、声音直方图(将每个类别的幅度映射到其相关声音的幅度)、移位器(将信号移位到可听范围)、标记器(标记特定条件的声音警报)。通过使用这些工具来为从相同数据生成的视频动画生成数据驱动的音轨,对这些工具进行了测试。所得到的视频向观看者提供增加的数据带宽和增加的虚拟现实感。
In analyzing abstract data sets, it is useful to represent them in several alternative formats, each format bringing out different aspects of the data. While most work in data mapping has focused on visual representations, it has been found that sonic representations can also be effective aids in interpreting complex data, especially when sonification is used in conjunction with visualization. The authors have developed prototypes for several high-level sonification tools that can be applied to a wide variety of data. While they used programmable multi- processor digital signal processing hardware to develop and experiment with these prototypes, each of these tools could be implemented as special-purpose hardware or software for use by scientists in specific applications. The prototype tools include: Mapper (maps data to various sonic parameters), Comparator (feeds a different mapping into each speaker channel), Sonic Histogram (maps the magnitude of each category onto the amplitude of its associated sound), Shifter (shifts signals into the audible range), Marker (a sonic alarm that marks a specific condition). These tools were tested by using them to generate data-driven sound tracks for video animations generated from the same data. The resulting videos provide an increased data bandwidth and an increased sense of virtual reality to the viewer.