A Study on Usages of Non-verbal Information for a Design of Information Assistive Tools
非语言信息在信息辅助工具设计中的使用研究
基本信息
- 批准号:14208028
- 负责人:
- 金额:$ 25.04万
- 依托单位:
- 依托单位国家:日本
- 项目类别:Grant-in-Aid for Scientific Research (A)
- 财政年份:2002
- 资助国家:日本
- 起止时间:2002 至 2004
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
We investigated how non-verbal information should be utilized in order to improve two information acquisition tools which we designed for the visually and auditory impaired.1.One of the tools is a new screen reader system which converts texts on the screen into synthesized speech while displaying rich text information, i.e. non-verbal information, onto a finger-tip surface by using a tactile jog-dial (TAJODA). This is a supporting tool of a web-information acquisition for visually impaired people.2.The other tool is a new hearing assistive device (captioning system) which automatically converts speech into texts while displaying speaker's lip-movement and facial expression, i.e. non-verbal information, for the acquired hearing impaired.Research results regarding "the screen reader" are as followings.(1)The speed of synthesized speech should be changed up to 3 times faster than normal speaking rate since our findings showed the maximum listening speeds for the blind is 2.6 times faster … More than the normal persons.(2)The optimal number of rich texts to transmit is 7;i.e. font sizes (larger or smaller than the standard), colored letter, bold, parentheses (left or right), and paragraph.(3)Experimental results by 8 blind users showed that the acquisition speed of web sentences becomes 2.6 times faster than ordinal screen reader.Research results regarding "the captioning system" are as followings.(1)We investigated how a speaker's facial image and lip-movement (the non-verbal information) were useful for the comprehension of the sentenses(2)Experimental results show that the lip-movement was more effective than facial expression and about 2 sec delay of the lip-movement display from the captions was suitable for the fascilitation of the comprehension.(3)By combining this captioning system with the non-verbal information, the comprehension was proved apparently fascilitated through about 30 times trials at international conferences.Non-verbal information ; the tactile stimulation in TAJODA and the lip-movement in the captioning system was apparently effective to fascilitate the comprehension of contents. Furthermore, we could determin the optimal parameters of the display timing and the display method of the non-verbal information in order to improve the information assistive tools for the sensory disabled. Less
我们研究了如何利用非语言信息,以改进我们为视觉和听觉障碍人士设计的两种信息获取工具。1.其中一种工具是一种新的屏幕阅读器系统,该系统将屏幕上的文本转换为合成语音,同时使用触觉滚轮(TAJODA)将丰富的文本信息(即非语言信息)显示到指尖表面上。这是视障人士获取网络信息的辅助工具。2.另一种工具是一种新型听力辅助设备(字幕系统),为获得的听障人士自动将语音转换为文本,同时显示说话者的嘴唇动作和面部表情,即非语言信息。有关“屏幕阅读器”的研究结果如下。(1)合成语音的速度应更改为3倍 比正常语速更快,因为我们的研究结果表明盲人的最大收听速度是正常人的 2.6 倍……更多。(2) 传输的富文本的最佳数量是 7;即字体大小(大于或小于标准)、彩色字母、粗体、括号(左或右)和段落。(3)8位盲人用户的实验结果表明,网络句子的获取速度比普通屏幕阅读器快2.6倍。有关“字幕系统”的研究结果如下。(1)我们研究了说话者的面部图像和嘴唇运动(非语言信息)如何有助于理解 (2)实验结果表明,唇动比面部表情更有效,并且字幕的唇动显示延迟约2秒适合理解的迷惑。(3)将该字幕系统与非语言信息相结合,经过约30次的国际会议试验,证明理解效果明显。 TAJODA 中的触觉刺激和字幕系统中的嘴唇运动显然可以有效促进内容的理解。此外,还可以确定非语言信息的最佳显示时机和显示方式参数,以完善针对感觉障碍者的信息辅助工具。较少的
项目成果
期刊论文数量(30)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Measurement of Mechanical Characteristics of a Fingerpad's Sureface in the Design of a Tactile Display
触觉显示器设计中指板表面机械特性的测量
- DOI:
- 发表时间:2003
- 期刊:
- 影响因子:0
- 作者:T.Homma;S.Ino;H.Kuroki;T.Ifukube
- 通讯作者:T.Ifukube
C.Asakawa, H.Takagi, S.Ino, T.Ifukube: "TAJODA : Proposed Tactile and JogDial Interface for Blind"IEICE. (In press). (2004)
C.Asakawa、H.Takagi、S.Ino、T.Ifukube:“TAJODA:建议盲人触觉和 JogDial 接口”IEICE。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
視聴覚障害者への音声提示における最適・最高速度
向听力和视力障碍人士提供音频演示的最佳/最大速度
- DOI:
- 发表时间:2005
- 期刊:
- 影响因子:0
- 作者:浅川智恵子;高木啓伸;井野秀一;伊福部達
- 通讯作者:伊福部達
加藤士雄, 井野秀一, 伊福部 達, 他: "国際会議における聴覚障害者支援を目的とした音声字幕変換システムの設計"ヒューマンインタフェース学会研究報告集. 4(4). 65-70 (2002)
Shio Kato、Shuichi Ino、Tatsu Ifukube 等人:“在国际会议上支持听力障碍人士的音频字幕转换系统的设计”人机界面协会研究报告 4(4) (2002)。
- DOI:
- 发表时间:
- 期刊:
- 影响因子:0
- 作者:
- 通讯作者:
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
IFUKUBE Tohru其他文献
IFUKUBE Tohru的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('IFUKUBE Tohru', 18)}}的其他基金
Practical research on wearable haptic interface to support sensory and communication disorders
支持感觉和沟通障碍的可穿戴触觉界面的实践研究
- 批准号:
26280070 - 财政年份:2014
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
Prototype Design and its Evaluation of a Mobile Phone Interface to Support"Seeing","Hearing", and"Speaking".
支持“看”“听”“说”的手机界面原型设计及其评估。
- 批准号:
21240058 - 财政年份:2009
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (A)
A study for practical use of metal hydride actuators having high performances used for assistive devises
辅助器具用高性能金属氢化物执行器的实用化研究
- 批准号:
11792030 - 财政年份:1999
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for University and Society Collaboration
Evaluation Study on Influences of Virtual Reality Stimulation on Human Body based on Biomedical Measurements
基于生物医学测量的虚拟现实刺激对人体影响的评价研究
- 批准号:
10305031 - 财政年份:1998
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (A).
Study for practical use of a digital hearing aid device having functions of speech rate convertion and intonation emphasis
具有语速转换和语调强调功能的数字助听器的实用化研究
- 批准号:
09559001 - 财政年份:1997
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
A study of sensory substitute systems based on biomedical acoustics
基于生物医学声学的感觉替代系统研究
- 批准号:
06402067 - 财政年份:1994
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (A)
Study fora Practical Use of an Electolarynx with a Pitch Control Function Using Expiration
具有使用呼气的音调控制功能的电子喉的实际使用研究
- 批准号:
06559001 - 财政年份:1994
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Developmental Scientific Research (B)
Development of a tactile display for a hand with sensory feedback
开发具有感官反馈的手部触觉显示器
- 批准号:
04555090 - 财政年份:1992
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Developmental Scientific Research (B)
Study of time-sequential signal processing of auditory nerves using a cochlear implant
使用人工耳蜗的听觉神经时序信号处理研究
- 批准号:
04455001 - 财政年份:1992
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for General Scientific Research (B)
A Study on Utility and improvement of Sensory Substitute Devices for Education Engineering of the Hearing Impaired.
听障教育工程感觉替代装置的实用与改进研究。
- 批准号:
02452300 - 财政年份:1990
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for General Scientific Research (B)
相似海外基金
A study on interactive class support system that quantifies learning effect using non-verbal information
利用非语言信息量化学习效果的互动课堂支持系统研究
- 批准号:
20K03099 - 财政年份:2020
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Effect of the visual non-verbal information in the communication
视觉非语言信息在沟通中的作用
- 批准号:
18K11414 - 财政年份:2018
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Interaction analysis for English dialogue materials development: Focusing on non-verbal information
英语对话材料开发的交互分析:关注非语言信息
- 批准号:
17K02953 - 财政年份:2017
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Understanding of others by social interaction through non-verbal information
通过非语言信息的社交互动了解他人
- 批准号:
16K00216 - 财政年份:2016
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
A Study on a Learning System Using Non-verbal Information with a Mobile Terminal Camera
基于移动终端摄像头的非语言信息学习系统研究
- 批准号:
24650563 - 财政年份:2012
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Challenging Exploratory Research
A study for displaying timing between verbal and non-verbal information for a real-time speech-to-caption system
实时语音转字幕系统中显示语言和非语言信息之间的时间安排的研究
- 批准号:
23501096 - 财政年份:2011
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Recording and Communication of non-verbal information in spatial art activity
空间艺术活动中非语言信息的记录与交流
- 批准号:
22800039 - 财政年份:2010
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Research Activity Start-up
Emotional responsibility and brain mechanism for non-verbal information to preterm infant in NICU.
NICU 早产儿非语言信息的情感责任和大脑机制。
- 批准号:
19830083 - 财政年份:2007
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Young Scientists (Start-up)
a study of conversation management method for e-learning employing non-verbal information
利用非语言信息进行电子学习的对话管理方法研究
- 批准号:
18700640 - 财政年份:2006
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Young Scientists (B)
Kansei Estimation for Communication Ability of Non-verbal Information by Real-Appearance Face Robot
真人脸机器人对非语言信息交流能力的感性估计
- 批准号:
17500151 - 财政年份:2005
- 资助金额:
$ 25.04万 - 项目类别:
Grant-in-Aid for Scientific Research (C)