Glove-based Tactile Streaming of Braille Characters and Digital Images for the Visually Impaired
为视障人士提供基于手套的盲文字符和数字图像触觉流传输
基本信息
- 批准号:10601900
- 负责人:
- 金额:$ 25.72万
- 依托单位:
- 依托单位国家:美国
- 项目类别:
- 财政年份:2023
- 资助国家:美国
- 起止时间:2023-09-30 至 2024-09-29
- 项目状态:已结题
- 来源:
- 关键词:12 year old3-DimensionalAddressAdultAgeAlgorithmic SoftwareBlindnessBraille DisplayCalibrationCharacteristicsChildCollectionCommunitiesComputer softwareConsultationsCouplingDataDevelopmentEncapsulatedEndowmentEngineeringEye diseasesFingersFoundationsFractureGenetic TranscriptionGoalsGrowthHandHealthImageIndividualLabelLengthManualsMapsMental DepressionModalityMonitorMultimediaNetwork-basedOptometristPalpablePaperPatientsPerceptionPhasePopulationPrevalenceProcessQuality of lifeReadabilityReaderReadingResearchResearch PersonnelResolutionRiskSculptureSemanticsStreamStudentsSurfaceSystemTabletsTactileTechnologyTextThumb structureTimeValidationVisionVisual AcuityVisual impairmentage relatedaging populationblindbraillecohortcomputerizeddeep learningdeep neural networkdemographicsdensitydesigndigitaldigital imagingdisabilityfall riskhaptic feedbackhaptic technologyhapticsindexinglexicalmultimodalityneural networkobject recognitionopen sourcepressurespatiotemporalvalidation studiesvirtual
项目摘要
This project will achieve a computerized system that supplies digital content, both lexical and graphical,
suitable for children, students and working adults of the Visually Impaired (VId) community, to increase their
autonomy and potentiate their Quality of Life and societal contribution. While there is notable academic
research, such as a high-density pin display tablet, there is no commercial, broadly functional, full-page
Braille reader. A tablet reader is potentially limiting in comparison with bimanual haptic gloves, limiting any
content complementary to Braille text. In contrast, haptic gloves support both Braille lexical content and
palpable digital images.
The proposed system will encapsulate a full-length Braille reader, not limited to a page at a time but
supplying a limitless stream of characters readable by four fingers in each hand as dictated by the content,
while also supporting haptic actuation of embedded pictorial content. This glove-based approach will unlock,
for an underserved VId clientele, a vast collection of multimedia content currently the exclusive domain of
the seeing population, as Braille lexical content and palpable bas-relief of graphical content.
Phase I will center on a haptic system for Braille display of full-length text, sensed by the fingers of both
hands and based on a redesigned commercial bimanual glove-based haptic system. A software algorithm
will stream and stagger the Braille content to each finger to replicate the bimanual reading process of a VId
reader. The system will also feature a tactile bas-relief version of digital images embedded in the text.
Phase II will develop Haptic VR, demonstrating the utility of overlaying Braille characters on a haptic
curved surface and paving the way for vitally important haptic sensing of labeled 2D/3D graphics by VId
users. A long-term goal is to apply this VR foundation to geolocated Haptic AR, enabling haptic overlay of
Braille labels on everyday surfaces, from appliances to groceries, by suitable integration of haptic rendering
with 3D range-sensing and DNN-based object recognition. Specific Aims – The Phase I Aims are as follows.
Aim 1. High-resolution haptic gloves for Braille streaming- Development of bimanual high-resolution haptic
gloves, featuring dense actuation at eight fingertips, by Haptx. The thumbs will also get haptic feedback.
Aim 2. Haptic rendering of lexical and graphical content
2A. Lexical reader - A software transcription will support spatiotemporal streaming of lexical data that
moves the haptic footprint of Braille characters serially from the first to the eighth finger.
2B. Graphical reader – The conversion of a digital image to a haptic bas-relief will exploit fast DNN-based
image semantic segmentation, where each label will be mapped to an actuator pressure.
2C. Finger-based calibration- Both modalities will be supported by a virtual page defined on a tabletop,
whose coordinates are found by a simple calibration based on three points identified by the index fingers.
这个项目将实现一个计算机化的系统,提供数字内容,包括词汇和图形,
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Michel Albert Audette其他文献
Michel Albert Audette的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Michel Albert Audette', 18)}}的其他基金
Approach-specific, multi-GPU, multi-tool, high-realism neurosurgery simulation
特定方法、多 GPU、多工具、高真实感神经外科模拟
- 批准号:
8123684 - 财政年份:2010
- 资助金额:
$ 25.72万 - 项目类别:
Approach-specific, multi-GPU, multi-tool, high-realism neurosurgery simulation
特定方法、多 GPU、多工具、高真实感神经外科模拟
- 批准号:
7801403 - 财政年份:2010
- 资助金额:
$ 25.72万 - 项目类别:
相似海外基金
REU Site: Design, Create, and Innovate 3-Dimensional User Interfaces to Improve Human Sensory and Motor Performance in Virtual Environments (HUMANS MOVE)
REU 网站:设计、创建和创新 3 维用户界面,以提高虚拟环境中的人类感官和运动表现 (HUMANS MOVE)
- 批准号:
2349771 - 财政年份:2024
- 资助金额:
$ 25.72万 - 项目类别:
Standard Grant
CAREER: Atomic-level understanding of stability and transition kinetics of 3-dimensional interfaces under irradiation
职业:对辐照下 3 维界面的稳定性和转变动力学的原子水平理解
- 批准号:
2340085 - 财政年份:2024
- 资助金额:
$ 25.72万 - 项目类别:
Continuing Grant
Artificial fabrication of 3-dimensional noncollinear magnetic order and magnetization manipulation by spin torque
三维非共线磁序的人工制造和自旋转矩磁化操纵
- 批准号:
23H00232 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Grant-in-Aid for Scientific Research (A)
Understanding of 3-dimensional seismic behavior of RC frame high-speed railway/highway viaducts using FE analysis
使用有限元分析了解 RC 框架高速铁路/公路高架桥的 3 维抗震性能
- 批准号:
23H01489 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
Modernization of 3-dimensional printing capabilities at the Aquatic Germplasm and Genetic Resource Center
水产种质和遗传资源中心 3 维打印能力的现代化
- 批准号:
10736961 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
The 3-dimensional nest of the honey bee: organization, development, and impact on colony function
蜜蜂的 3 维巢穴:组织、发育及其对蜂群功能的影响
- 批准号:
2216835 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Standard Grant
Research on high-density 3-dimensional polymer optical waveguide device for photonics-electronics convergence
光电子融合高密度三维聚合物光波导器件研究
- 批准号:
23H01882 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Grant-in-Aid for Scientific Research (B)
Scaff-Net: 3 Dimensional multiphoton polymerisation printed scaffolds for medium throughput recording from stem cell derived human cortical networks.
Scaff-Net:3 维多光子聚合打印支架,用于从干细胞衍生的人类皮质网络进行中等通量记录。
- 批准号:
EP/X018385/1 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Research Grant
3-dimensional prompt gamma imaging for online proton beam dose verification
用于在线质子束剂量验证的 3 维瞬发伽马成像
- 批准号:
10635210 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Equipment: MRI: Track 1 Acquisition of a 3-Dimensional Nanolithography Instrument
设备:MRI:轨道 1 获取 3 维纳米光刻仪器
- 批准号:
2320636 - 财政年份:2023
- 资助金额:
$ 25.72万 - 项目类别:
Standard Grant