Cloudfinity - Phase 1 Recognition of cockpit controls manipulation using COTS sensors

Cloudfinity - 第一阶段使用 COTS 传感器识别驾驶舱控制操作

• 批准号: 478004-2015
• 负责人: Laurendeau, Denis
• 金额: $ 1.82万
• 依托单位: Université Laval
• 依托单位国家: 加拿大
• 项目类别: Engage Grants Program
• 财政年份: 2015
• 资助国家: 加拿大
• 起止时间: 2015-01-01 至 2016-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=579233
• 关键词: Cloudfinity; Phase; Recognition; cockpit; controls

the trainer and the trainee be co-located at the same site during a training session. A distributed simulator training technology for which co-location of the trainee/trainer is not required, flight simulation training hardware/software is not co-located with client training platforms, and the cockpit environment of the training platform is rendered via virtual reality (as opposed to having physical cockpit panels) would have a significant economic impact since a trainer could follow the training sessions of many trainees located at remote locations simultaneously. To achieve this in a distributed environment, the activity of the trainee must be captured and displayed to the trainer. Important types of activity are the pose of the user in the platform and hand gestures performed when virtually manipulating different controls of the platform. In the long term, activity tracking in a representative aircraft simulator virtual cockpit should be possible. A first step for reaching this long term objective consists in monitoring trainee activity when interacting with a selection of typical controls on aircraft panels (or a virtual representation of these panels) and rendering this activity to the trainee/trainer in an immersive environment. The goals of the project are to recognize with good accuracy the hand gestures of the pilot when manipulating various controls, locate and detect which control is manipulated, establish optimal sensor configuration to detect manipulations on panels positioned on the overhead, glareshield and pedestal and use a virtual representation of panels for these manipulations. A challenge is that the sensors and displays must be low-cost COTS devices, be non-intrusive and function in

在培训期间，培训师和受训者应在同一地点办公。