面向视障者应用的触摸屏图像的多模式力触觉再现方法研究

批准号:
62003169
项目类别:
青年科学基金项目
资助金额:
24.0 万元
负责人:
陈大鹏
依托单位:
学科分类:
人工智能驱动的自动化
结题年份:
2023
批准年份:
2020
项目状态:
已结题
项目参与者:
陈大鹏
国基评审专家1V1指导 中标率高出同行96.8%
结合最新热点,提供专业选题建议
深度指导申报书撰写,确保创新可行
指导项目中标800+,快速提高中标率
微信扫码咨询
中文摘要
向视障者传达图像信息是提升他们生活质量的重要手段。近年来,具有便携、数据可刷新和成本低等优点的触摸屏设备在日常生活中的普及,为视障者便捷地访问图像提供了一条非常有前景的途径。然而,由于计算能力有限且缺乏丰富的触感,日常使用的触摸屏设备难以有效地向视障者传达图像中的信息。针对以上现状和问题,本项目拟以人的触觉生理特性为基础,通过将深度学习和力触觉再现等技术应用于触摸屏设备,研发一套能满足交互实时性需求且具有力触觉真实感的图像再现系统。重点研究基于深度学习的快速图像特征提取算法、结合纹理特征和工具运动信息的图像纹理再现方法、对触摸屏中的图像进行多模式力触觉再现的装置和表达方法,以及主客观的图像再现实验和视障者的感知效果评价等内容。本项目的实施将为视障者在触摸屏上感知图像的视觉属性信息提供技术支撑,为视障者与数字世界的无障碍交流提供新的研究思路,并促进力触觉人机交互和助盲助残等领域的发展。
英文摘要
Communicating image information to the visually impaired is an important means to improve their quality of life. In recent years, the popularity of touch screen devices with the advantages of portability, refreshable data, and low cost in daily life has provided a very promising way for the visually impaired to easily access image. However, due to limited computing power and lack of rich haptic sensations, daily-used touch screen devices cannot effectively convey image information to the visually impaired. In view of the above status quo and problems, and based on the haptic physiological characteristics of human beings, this project intends to develop a set of image display systems that can meet the real-time needs of interaction and have haptic realism by applying technologies such as deep learning and haptic display to touch screen devices. Key research contents include fast image feature extraction algorithms based on deep learning, image texture display methods combining texture features and tool motion information, device and expression methods for performing multi-mode haptic display of images on the touch screen, and subjective and objective image display experiments and evaluation of the perception effect of the visually impaired. The implementation of this project will provide technical support for visually impaired people to perceive the visual attribute information of images on the touch screen, provide new research ideas for barrier-free communication between the visually impaired and the digital world, and promote the development of fields such as haptic human-computer interaction and assisting blindness and disability.
期刊论文列表
专著列表
科研奖励列表
会议论文列表
专利列表
DOI:10.1109/tmrb.2022.3146743
发表时间:2022-02-01
期刊:IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS
影响因子:--
作者:Hu, Xuhui;Song, Aiguo;Chen, Dapeng
通讯作者:Chen, Dapeng
DOI:10.1109/tnsre.2022.3181284
发表时间:2022-06
期刊:IEEE Transactions on Neural Systems and Rehabilitation Engineering
影响因子:4.9
作者:Hong Zeng;Weijie Yu;Dapeng Chen;Xuhui Hu;Dingguo Zhang;Ai-Guon Song
通讯作者:Hong Zeng;Weijie Yu;Dapeng Chen;Xuhui Hu;Dingguo Zhang;Ai-Guon Song
DOI:10.3389/fnbot.2022.990453
发表时间:2022
期刊:Frontiers in neurorobotics
影响因子:3.1
作者:
通讯作者:
DOI:10.15888/j.cnki.csa.009203
发表时间:2023
期刊:计算机系统应用
影响因子:--
作者:刘佳;林潇;陈大鹏;徐闯;石豪
通讯作者:石豪
DOI:10. 19650 / j. cnki. cjsi. J2210720
发表时间:2023
期刊:仪器仪表学报
影响因子:--
作者:陈大鹏;朱栋梁;刘佳;宋爱国;陈庚
通讯作者:陈庚
国内基金
海外基金
