Custom Gesture Recognition Solution

点击翻译按钮获取中文摘要

Xesto Inc. is a Canadian tech developer of a web-based gesture recognition platform that will allow developers to enhance users' ability to control and interact with devices using hand gestures that do not require touching a screen or other controls. Applications for this platform include mobile and cloud-based services for entertainment, automotive, health/wellness, productivity, and business/product discovery. Xesto currently works with automotive companies on touchless dashboards and has had interest from various other industries (augmented & virtual reality producers, healthcare/wellness organizations, retail/online vendors, etc.). ** Xesto seeks to collaborate with Sheridan's Screen Industries Research and Training Centre (SIRT) to further develop their innovative gesture recognition product into a version compatible with phones and other mobile devices. The enhanced system aims to provide custom gesture recognition for the iPhone's Augmented Reality (AR) Kit, with modularity that allows portability to Google's AR Core and hardware/software integration on other devices. ** Currently, most companies that focus on gesture detection on mobile phones don't utilize a depth camera, relying solely on a less accurate and efficient RGB camera to detect and track hands. Xesto and SIRT propose to conduct research to identify and optimize hand tracking, hand segmentation and gesture recognition algorithms, which will allow a system to run on any type of device or platform using a depth camera. The anticipated research outcomes will enable Xesto to broaden its expertise and services to assist developers and clients from multiple sectors, and provide the 'go-to tool' for gesture recognition in AR/VR experiences and applications. This will further Xesto's development of creating and marketing an innovative, industry leading device-agnostic gesture-detection system that will leverage the shift from 2D to 3D gesture detection and recognition. There are currently no major gesture companies in the market, and in a few years gesture-based technology will be commonplace. ****