Assessment of an on-device eye-tracking communication implementation using the iPhone/iPad capabilities**

点击翻译按钮获取中文摘要

Stephen Hawking was a brilliant scientist who helped shape our understanding of physics and the universe, while reliant on assistive technologies due to ALS. Such technologies generally rely on expensive special hardware and software. Cameras on every smartphone provides the possibility for a widespread consumer solution for assistive eye tracking for people with limited mobility. The iPhone X TrueDepth camera incorporates face-tracking and eye-tracking for use in iOS applications, which may provide the first real low-cost alternative for assistive technology. First, we will determine how to maximize the effectiveness of the new gaze tracking system on the iPhone X in terms of distance and angles for a wheelchair mounted camera. This will determine the best placement of the smartphone. The information about the resolution and robustness of the gaze tracking will be integrated into the development of Cognixion's Speakprose app to make the leap from a touch-based to a gaze-based interface. Next, we will investigate the usability of the gaze tracking in locked-in individuals engaged in a normal social interaction. We will record the eye movements while the system is being used to exchange pleasantries at the start of a physiotherapy session. We will also measure the user's comfort and fatigue levels when using the system. Together, these metrics will provide Cognixion with a measure of how usable the system is in a real-world environment, which can be used to evaluate how future changes to their system improves or impairs the user experience. This will allow for development of a system that meets the needs of the mobility impaired. This project combines vision research on human factors for limited mobility individuals with technological solutions to provide more accessible assistive device solutions. The objectives are to 1) characterize Apple's new gaze tracking system for use in assistive applications; and 2) develop metrics to assess the usability of the gaze system by individuals with limited mobility. The results will have significant impact on developing low-cost assistive gaze tracking solutions.******