Assessment of an on-device eye-tracking communication implementation using the iPhone/iPad capabilities**

斯蒂芬·霍金是一位杰出的科学家，他帮助塑造了我们对物理和宇宙的理解，同时由于ALS依赖辅助技术。这些技术通常依赖于昂贵的特殊硬件和软件。每部智能手机上的摄像头为行动不便的人提供了广泛的辅助眼动追踪解决方案。iPhone X TrueDepth摄像头结合了面部追踪和眼球追踪功能，可用于iOS应用程序，这可能为辅助技术提供第一个真正的低成本替代方案。首先，我们将确定如何最大限度地提高iPhone X上的新凝视跟踪系统在距离和角度方面对轮椅安装的摄像头的有效性。这将决定智能手机的最佳位置。有关注视跟踪的分辨率和稳健性的信息将被整合到Cognixion的Speakprose应用程序的开发中，以实现从基于触摸的界面到基于注视的界面的飞跃。接下来，我们将研究凝视跟踪在从事正常社会互动的闭锁个体中的可用性。在物理治疗开始时，我们将记录患者的眼球运动，并使用该系统进行寒暄。我们还将测量用户在使用系统时的舒适度和疲劳程度。总之，这些指标将为Cognixion提供系统在实际环境中的可用性度量，可用于评估将来对系统的更改如何改进或损害用户体验。这将允许开发一个满足行动不便者需求的系统。本项目结合对行动不便人士的人为因素的视觉研究与技术解决方案，提供更方便的辅助装置解决方案。目标是1)描述苹果在辅助应用程序中使用的新凝视跟踪系统；2)制定指标来评估行动不便的个人对凝视系统的可用性。研究结果将对开发低成本的辅助注视跟踪解决方案产生重大影响。******

Stephen Hawking was a brilliant scientist who helped shape our understanding of physics and the universe, while reliant on assistive technologies due to ALS. Such technologies generally rely on expensive special hardware and software. Cameras on every smartphone provides the possibility for a widespread consumer solution for assistive eye tracking for people with limited mobility. The iPhone X TrueDepth camera incorporates face-tracking and eye-tracking for use in iOS applications, which may provide the first real low-cost alternative for assistive technology. First, we will determine how to maximize the effectiveness of the new gaze tracking system on the iPhone X in terms of distance and angles for a wheelchair mounted camera. This will determine the best placement of the smartphone. The information about the resolution and robustness of the gaze tracking will be integrated into the development of Cognixion's Speakprose app to make the leap from a touch-based to a gaze-based interface. Next, we will investigate the usability of the gaze tracking in locked-in individuals engaged in a normal social interaction. We will record the eye movements while the system is being used to exchange pleasantries at the start of a physiotherapy session. We will also measure the user's comfort and fatigue levels when using the system. Together, these metrics will provide Cognixion with a measure of how usable the system is in a real-world environment, which can be used to evaluate how future changes to their system improves or impairs the user experience. This will allow for development of a system that meets the needs of the mobility impaired. This project combines vision research on human factors for limited mobility individuals with technological solutions to provide more accessible assistive device solutions. The objectives are to 1) characterize Apple's new gaze tracking system for use in assistive applications; and 2) develop metrics to assess the usability of the gaze system by individuals with limited mobility. The results will have significant impact on developing low-cost assistive gaze tracking solutions.******