Study on a personal digital assistance for the visually impaired using tactile and virtual sound interface

PC界面是基于使用定点设备的GUI创建的。但是，对于视力残疾的人来说，这是非常困难的。视障人士使用个人电脑的主要原因是使用互联网、在网上访问报纸出版公司以阅读报纸的最新文章，以及使用电子邮件与朋友联系。然而，这些任务可以通过使用屏幕阅读器来完成，例如。为了使用互联网，需要一种能够高速处理大量信息的新型PC。一般来说，它们是像Windows一样的GUI机器，所以视障人士也会使用GUI PC。GUI布局在信息的表达或PC的操作中起着重要的作用，但是顺序读取字符的屏幕读取器根本不考虑GUI布局。许多视障使用者都有辨识版面的愿望，在本研究中，我们展示如何使用一种新的本地化声音系统作为支援系统来辨识版面 ...更多信息 GUI对象。这些对应于GUI对象的局部化声音是使用正中平面中的HRTF和水平平面中的双耳之间的耳间差异来创建的。滤波是由于来自人体躯干、头部和耳廓的反射和衍射，并且由HRTF描述。当使用听者自己的HRTF来合成声音定位线索时，双耳合成工作得非常好。通过使用HRTF和耳机呈现的声音的双耳合成的装置进行计算模拟。我们发现，通过在垂直方向上使用来自耳廓附近的声源的白色噪声采样获得的声音容易定位。作为GUI布局的一个简单的模型，提出了一个25按钮布局与本地化的声音添加到每个按钮，并检查本地化的声音用于把握按钮的位置的有效性。经过仔细考虑，我们发现除了引导鼠标光标之外，虚拟声音屏幕还可以用于识别GUI对象的布局。此外，我们还考察了视障者是否可以自己制作正式的基本图形。我们在本报告中处理的模式仅限于线条的集合。为了制作正式的图案，我们准备了一个丙烯酸笔输入指南，并将其放在平板电脑上。这个指南有一个9乘9的孔格，对应于二维虚拟声音屏幕上的9乘9的局部声音。使用这个指南和手写笔，视障人士可以作出一个模式。通过听到局部声音来检查和校正输入模式。实验表明，被试能够正确地输入简单的模式。少

PC interfaces are created based on GUIs which use a pointing device. However it is very hard for those who have visual disabilities to use. The reason that visually impaired persons use PCs is mainly to use the Internet, to access a newspaper publishing company on the Web to read the latest articles of a newspaper, and to contact friends using E-mail. However, these tasks can be done by using a screen reader, e.g.. In order to use the Internet, a new PC which processes a lot of information at high speed is desired. Generally they are GUI machines like Windows, so visually impaired persons will also use a GUI PC. The GUI layout plays an important role in the expression of information or the operation of the PC, but a screen reader which reads characters sequentially does not take into account the GUI layout at all. Many visually impaired users have a desire to recognize the layout.In this study, we show how to use a new localized sound system as a support system to recognize the layout … More of GUI objects. These localized sounds that correspond to the GUI objects are created using by HRTFs in the median plane and interaural differences between both ears in the horizontal plane. The filtering is due to reflections and diffractions from the human torso, head and pinna, and is described by HRTFs. Binaural synthesis works extremely well when the listener's own HRTFs are used to synthesize the sound localization cues. The computational simulation is made by means of binaural synthesis using HRTFs and sound presented by headphones. We found that the sound obtained by sampling in the vertical direction using white noise from a sound source near the pinna was easy to locate. As a simple model of a GUI layout, a 25 button layout with a localized sound added to each button is proposed, and the effectiveness of the localized sounds for grasping the position of the buttons is examined. After much consideration, we found that the virtual sound screen could be applied to recognize the layout of GUI objects in addition to leading a mouse cursor. Also, we examine whether or not a visually impaired person can make a formal basic figure by himself. The patterns that we treat in this report are restricted to a collection of lines. In order to make formal patterns, we prepared an acrylic pen input guide and put it on a tablet. This guide has a 9 by 9 lattice of holes which correspond to 9 by 9 localized sounds on a 2-dimensional virtual sound screen. Using this guide and a stylus pen, the visually impaired can make a pattern. The input pattern is checked and corrected by hearing the localized sound. Experiments show that the subjects can input simple patterns correctly. Less