Assessment of an on-device eye-tracking communication implementation using the iPhone/iPad capabilities**

使用 iPhone/iPad 功能评估设备上眼动追踪通信实施**

• 批准号: 537573-2018
• 负责人: Fallah, Mazyar
• 金额: $ 1.82万
• 依托单位: York University
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2018
• 资助国家: 加拿大
• 起止时间: 2018-01-01 至 2019-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=650419
• 关键词: Assessment; device; eye; tracking; communication

Stephen Hawking was a brilliant scientist who helped shape our understanding of physics and the universe, while reliant on assistive technologies due to ALS. Such technologies generally rely on expensive special hardware and software. Cameras on every smartphone provides the possibility for a widespread consumer solution for assistive eye tracking for people with limited mobility. The iPhone X TrueDepth camera incorporates face-tracking and eye-tracking for use in iOS applications, which may provide the first real low-cost alternative for assistive technology. First, we will determine how to maximize the effectiveness of the new gaze tracking system on the iPhone X in terms of distance and angles for a wheelchair mounted camera. This will determine the best placement of the smartphone. The information about the resolution and robustness of the gaze tracking will be integrated into the development of Cognixion's Speakprose app to make the leap from a touch-based to a gaze-based interface. Next, we will investigate the usability of the gaze tracking in locked-in individuals engaged in a normal social interaction. We will record the eye movements while the system is being used to exchange pleasantries at the start of a physiotherapy session. We will also measure the user's comfort and fatigue levels when using the system. Together, these metrics will provide Cognixion with a measure of how usable the system is in a real-world environment, which can be used to evaluate how future changes to their system improves or impairs the user experience. This will allow for development of a system that meets the needs of the mobility impaired. This project combines vision research on human factors for limited mobility individuals with technological solutions to provide more accessible assistive device solutions. The objectives are to 1) characterize Apple's new gaze tracking system for use in assistive applications; and 2) develop metrics to assess the usability of the gaze system by individuals with limited mobility. The results will have significant impact on developing low-cost assistive gaze tracking solutions.******

斯蒂芬·霍金是一位杰出的科学家，他帮助塑造了我们对物理和宇宙的理解，同时依赖于ALS的辅助技术。这些技术通常依赖于昂贵的专用硬件和软件。每部智能手机上的摄像头都为行动不便的人提供了广泛的辅助眼动追踪消费者解决方案。iPhone X TrueDepth摄像头集成了用于iOS应用程序的面部跟踪和眼睛跟踪功能，这可能是辅助技术的第一个真实的低成本替代方案。首先，我们将确定如何最大限度地提高iPhone X上新的视线跟踪系统在轮椅安装摄像头的距离和角度方面的有效性。这将决定智能手机的最佳位置。有关视线跟踪的分辨率和鲁棒性的信息将被集成到Cognixion的Speakprose应用程序的开发中，以实现从基于触摸的界面到基于注视的界面的飞跃。 接下来，我们将调查锁定在个人从事正常的社会交往的视线跟踪的可用性。在物理治疗开始时，我们将记录系统用于交流寒暄时的眼球运动。我们还将测量用户在使用系统时的舒适度和疲劳度。总之，这些指标将为Cognixion提供一个衡量系统在现实环境中可用性的指标，可用于评估系统未来的变化如何改善或损害用户体验。这将有助于开发一个满足行动不便者需求的系统。该项目将对行动不便者的人为因素的视觉研究与技术解决方案相结合，以提供更容易获得的辅助设备解决方案。其目标是：1）描述Apple新的凝视跟踪系统在辅助应用中的使用; 2）开发指标，以评估行动不便的个人对凝视系统的可用性。研究结果将对开发低成本的辅助视线跟踪解决方案产生重大影响。