Sound for the exploration of space physics data
Sound for the exploration of space physics data
复制标题
DOI：
--
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
W. Merced
中科院分区：
文献类型：
--
作者：
W. Merced
当前空间物理二维数值数据的分析技术基于用眼睛仔细检查数据。从星际介质的自然实验室获取的空间物理数据集可能包含可能被噪声掩盖的事件，从而难以识别。本论文介绍了使用声音作为当前数据可视化技术的辅助手段来探索、分析和增强空间物理数据中的特征的研究。这项研究提出了一种新的声化技术，可将空间物理数据集分解为感兴趣的不同成分（频率、振荡模式等），并将其用作数据可视化的辅助手段，以探索和分析具有非线性特征的空间科学数据集（不满足叠加原理，或其输出与其输入不成比例的系统）。综合多感官知觉、人类注意机制等方面，本论文解决的问题是：声音用作当前数据可视化的辅助手段，是否增强了对噪声掩盖的空间物理数据中特征的感知？为了回答这个问题，必须回答以下附加问题：a）当信号的出现存在动态变化的竞争性认知负荷（噪声）时，当信号的出现存在动态变化的竞争性认知负荷（噪声）时，声音是否可以有效地提高对在有人值守、无人值守、意外位置、空间延伸的信号的敏感性，从而使信号在视觉上模糊不清？ b）如何将多模态感知（听起来是可视化的辅助）和注意力控制机制结合起来，以帮助分配注意力来识别视觉上模糊的信号？这些问题的目的之一是研究与仅视觉显示相比，在数据中存在视觉噪声的情况下，将声音与视觉显示结合使用来提高信号检测灵敏度的有效性。使用作为本研究的一部分开发的超声技术来探索无线电、粒子、波和高能数据。作为本研究的一部分开发的可听化技术，其应用和结果经过数值验证和呈现。本文介绍了三个实验的结果和一个训练实验的结果。在所有 4 个实验中，志愿者使用声音作为数据可视化的辅助手段来识别图形视觉和音频表示的变化，并将这些结果与仅使用音频渲染和仅使用视觉渲染的结果进行比较。在第一个实验中，单独使用或与视觉显示器一起使用时，音频渲染并没有带来显着的好处。在第二个和第三个实验中，当将第四个提示添加到频谱中时，音频作为视觉渲染的辅助手段变得很重要。第四个提示由一条红线组成，以声音播放的速度扫过视觉显示器，以同步音频和视觉呈现。结果证明，与声音同步的第三个一致的多模态刺激有助于空间科学家识别二维数据中被噪声掩盖的事件。报告训练实验的结果。
Current analysis techniques for space physics 2D numerical data are based on scruti-nising the data with the eyes. Space physics data sets acquired from the natural lab of the interstellar medium may contain events that may be masked by noise making it difficult to identify. This thesis presents research on the use of sound as an adjunct to current data visualisation techniques to explore, analyse and augment signatures in space physics data. This research presents a new sonification technique to decom-pose a space physics data set into different components (frequency, oscillatory modes, etc…) of interest, and its use as an adjunct to data visualisation to explore and analyse space science data sets which are characterised by non-linearity (a system which does not satisfy the superposition principle, or whose output is not propor-tional to its input). Integrating aspects of multisensory perceptualization, human at tention mechanisms, the question addressed by this dissertation is: Does sound used as an adjunct to current data visualisation, augment the perception of signatures in space physics data masked by noise? To answer this question, the following additional questions had to be answered: a) Is sound used as an adjunct to visualisation effective in increasing sensi-tivity to signals occurring at attended, unattended, unexpected locations, extended in space, when the occurrence of the signal is in presence of a dynamically changing competing cognitive load (noise), that makes the signal visually ambiguous? b) How can multimodal perceptualization (sound as an adjunct to visualisa-tion) and attention control mechanisms, be combined to help allocate at-tention to identify visually ambiguous signals? One aim of these questions is to investigate the effectiveness of the use of sound to-gether with visual display to increase sensitivity to signal detection in presence of visual noise in the data as compared to visual display only. Radio, particle, wave and high energy data is explored using a sonification technique developed as part of this research. The sonification technique developed as part of this research, its application and re-sults are numerically validated and presented. This thesis presents the results of three experiments and results of a training experiment. In all the 4 experiments, the volun-teers were using sound as an adjunct to data visualisation to identify changes in graphical visual and audio representations and these results are compared with those of using audio rendering only and visual rendering only. In the first experiment audio rendering did not result in significant benefits when used alone or with a visual display. With the second and third experiments, the audio as an adjunct to visual rendering became significant when a fourth cue was added to the spectra. The fourth cue con-sisted of a red line sweeping across the visual display at the rate the sound was played, to synchronise the audio and visual present. The results prove that a third congruent multimodal stimulus in synchrony with the sound helps space scientists identify events masked by noise in 2D data. Results of training experiments are reported.