权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

A Study of Barrier-free Communication Systems Using Virtual Reality Technology for Deaf People

利用虚拟现实技术的聋人无障碍通信系统研究

基本信息

批准号：
15300189
负责人：
INO Shuichi
金额：
$ 8.96万
依托单位：
The University of Tokyo
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (B)
财政年份：
2003
资助国家：
日本
起止时间：
2003 至 2005
项目状态：
已结题

项目摘要

In this research project, we developed three types of barrier-free communication system for people with hearing disability. These systems employ the recent technology such as a sensory display in virtual reality and a wearable PC in human interface technology. Specifically the results of this project are described in the following paragraphs.1.A portable automatic note-taking system has been designed to allow face-to-face communication between deaf and hearing people. This system is mainly composed of a lightweight optical see-through HMD, a wearable PC and speech recognition software. To confirm a margin of safety of the VR display system, human influences were examined neuro-ophthalmologically. It was found that visual load by the VR display for a long time affected ocular accommodation and pupillary movement in healthy subjects.2.Our compact tactile aid utilizes a multi-channel vibrotactile display. To assist deaf people at speech reading, this tactile communication device converts … More voice information into vibrotactile stimulation on a fingertip. We investigate here biomechanical characteristics of fingerpad skin to generate adequate tactile stimulus for voice communication and design a broadband vibrotactile display composed of small piezoelectric bimorph actuators. From the results of psychophysical experiments, it was suggested that our tactile aid should allow to present voice quality of a speaker on the fingertip.3.A real-time captioning system was developed for public communication at a meeting or the lectures of a school. This system consists of a LCD projector instead of the MHD of the above note-taking system, a simultaneous respeaking operator to respond more flexibly to various speakers, and a device for superimposing the images of a speaker and a caption on a large screen. Furthermore we examined the optimal spatiotemporal parameters of superimposing the images of a speaker and a caption to improve communication accuracy for deaf users. This system is now available at an international meeting and the lectures of some universities in Japan. Less

在这个研究项目中，我们为听力障碍人士开发了三种类型的无障碍通信系统。这些系统采用了最新技术，例如虚拟现实中的感官显示和人机界面技术中的可穿戴电脑。具体而言，该项目的结果在以下段落中描述。1.设计了一种便携式自动笔记系统，以允许聋哑人和听力正常的人之间进行面对面的交流。该系统主要由轻型光学透视HMD、可穿戴PC和语音识别软件组成。为了确认 VR 显示系统的安全边际，我们从神经眼科角度检查了人类的影响。研究发现，长期 VR 显示器的视觉负荷会影响健康受试者的眼部调节和瞳孔运动。2.我们的紧凑型触觉辅助设备采用多通道振动触觉显示器。为了帮助聋人阅读语音，这种触觉通信设备将语音信息转换为指尖上的振动触觉刺激。我们在这里研究指垫皮肤的生物力学特征，以产生用于语音通信的足够的触觉刺激，并设计由小型压电双压电晶片执行器组成的宽带振动触觉显示器。从心理物理学实验的结果来看，我们的触觉辅助工具应该能够在指尖上呈现说话者的语音质量。3.开发了一种实时字幕系统，用于会议或学校讲座中的公共交流。该系统由液晶投影仪代替上述笔记系统的MHD、同步复述操作器以更灵活地响应各种发言者以及在大屏幕上叠加发言者图像和字幕的装置组成。此外，我们还研究了叠加说话者图像和字幕的最佳时空参数，以提高聋人用户的通信准确性。该系统现已在国际会议和日本一些大学的讲座中使用。较少的

项目成果

期刊论文数量（55）

专著数量（0）

科研奖励数量（0）

会议论文数量（0）

专利数量（0）

C.Asakawa: "TAJODA : Proposed Tactile and Jog-Dial Interface for the Blind"IEICE Transactions on Information and Systems. (in press). (2004)

C.Asakawa：“TAJODA：建议盲人触觉和滚轮拨号界面”IEICE 信息和系统交易。

DOI：
发表时间：
期刊：
影响因子：
0
作者：
通讯作者：

Actual condition and issues of a caption system using automatic speech recognition technology

采用自动语音识别技术的字幕系统的现状和问题

DOI：
发表时间：
2006
期刊：
Research in Educational Plactice and Development, Gunma University 23
影响因子：
0
作者：
S.Nakano;I.Makihara;T.Kanazawa;M.Kikuchi;H.Kuroki;S.Ino;T.Ifukube;S.Fukushima
通讯作者：
S.Fukushima

Measurement of Mechanical Characteristics of a Fingerpad Surface in the Design of a Tactile Display

触觉显示器设计中指板表面机械特性的测量