权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

On Human Factor in a Virtual Space Integrating Visual Auditory and tactile Modalities

视觉听觉触觉相结合的虚拟空间中的人为因素

基本信息

批准号：
09838004
负责人：
YONEKURA Tatsuhiro
金额：
$ 1.6万
依托单位：
Ibaraki University
依托单位国家：
日本
项目类别：
Grant-in-Aid for Scientific Research (C)
财政年份：
1997
资助国家：
日本
起止时间：
1997 至 1998
项目状态：
已结题

项目摘要

1. During the last decade the technology for implementation of a virtual space or a cyberspace has been improved from both of the hardware and the software viewpoints. Based on such environment the authors have attempted to establish the theoretical methodological basics regarding the way of integrating the visual, auditory and tactile modalities. In this report, on the preparation for the objective, we have researched the way of human's sensory substitution of how the visual modality for spatial perception is substituted by another modality (e.g.auditory or tactile modality). That is, by proposing the three dimensional (3-D hereafter) interaction strategy using 3-D auditory display and 3-D nonverbal voice input, the authors have shown experimentally that manipulating 3-D object might be sufficiently performed without any visual information by utilizing suitable auditory interface with a short term practice. By doing so, not only confirmation of the significance auditory modality is ma … More de, but also the possibility of virtual spatial manipulation just by auditory media is implied.2. Secondly the authors have attempted the similar research on the sensory substitution function by tactile media. That is, by proposing tactile feedback mechanism for display of depth information of the surroundings of a user calculated by the ultrasonic sensor mounted on user' body, the possibility of spatial perception and spatial manipulation by tactile modality in case of the absence of visual modality is researched. As a result, the authors have confirmed that either auditory modality or tactile modality might be able to substitute satisfactorily the visual modality in terms of spatial perception by psychological experiments as well as task performance experiments, which would be a significant contribution to a new type of man machine interface for disabled or handicapped person.3. Moreover, several examples of application which integrates these modalities are shown for implementing efficient cyber space, to discuss the importance of multi-modal interface. Our future works include the research of human's environmental adaptability in terms of realization for reality of a virtual space, including temporal human factor for distributed virtual environment (DVE) and televirtuality (TVR). Less

1.在过去的十年中，用于实现虚拟空间或网络空间的技术已经从硬件和软件两个方面得到了改进。基于这样的环境，作者试图建立关于整合视觉、听觉和触觉形式的理论方法学基础。在这份报告中，在为目标做准备的过程中，我们研究了人类的感觉替代方式，即空间感知的视觉模态如何被另一种模态（例如听觉或触觉模态）替代。也就是说，通过提出使用3-D听觉显示和3-D非语言语音输入的三维（3-D以下）交互策略，作者已经通过实验表明，通过利用合适的听觉接口和短期实践，可以在没有任何视觉信息的情况下充分地执行操纵3-D对象。这样做，不仅证实了听觉通道的重要性， ...更多信息 de，但也暗示了仅通过听觉媒介进行虚拟空间操作的可能性.其次，作者对触觉媒介的感觉替代功能进行了类似的研究。也就是说，通过提出用于显示由安装在用户身体上的超声波传感器计算的用户周围的深度信息的触觉反馈机制，研究了在不存在视觉模态的情况下通过触觉模态进行空间感知和空间操纵的可能性。因此，作者通过心理学实验和任务执行实验证实了听觉或触觉模态在空间感知方面都可以令人满意地替代视觉模态，这将对残疾人或残疾人的新型人机接口做出重大贡献.此外，几个应用程序的例子，集成这些形式的实施有效的网络空间，讨论多模态接口的重要性。我们未来的工作包括研究人的环境适应性方面的实现，为现实的一个虚拟空间，包括时间的人的因素，分布式虚拟环境（DVE）和远程虚拟（TVR）。少