A biometric environment, neural control and A.I guidance for assessing video games and immersions

点击翻译按钮获取中文摘要

This research is aimed at developing tools that recognize the emotions and cognitive states of users in a video game situation, and methods to reduce and control their impact . Recognition and control will be based on Artificial Intelligence (AI) techniques such as machine learning and agents. We aim to set up the tools able to measure emotional engagement and workload using games environments and immersions. For instance, we want to identify scenes in a video game which provide positive or negative emotions, fun, boredom, attraction, etc. A Biometric environment will be able to identify frustrating elements as well as motivating scenes. To allow that we intend to develop an Augmented Reality (AR) and Virtual Reality (VR) glasses environment control and tools to assess and leverage emotional components which arise when a user interacts. As well, we intend to identify, adapt and optimize the best neural control input methods and AI avatar guidance for AR and VR glasses. With these aspects in mind, we wish to develop tools for the detection and analysis of emotional and cognitive reactions during interactions in order to improve the user-friendliness of human-machine interfaces and video games. The scientific approach will be based on targeting several biometric tools which functionalities will be progressively defined. Then the tools will be implemented and tested in several video games and immersions suitable for AR and VR glasses. Neural agents will be developed to follow and influence user's emotions. The Biometric environment is supported by a CFI grant that we have obtained and which provides access to numerous tools for assessing emotional and behavioral conditions of user interactions in a game (EEG systems, Eye tracking systems and glasses, Virtual Reality Helmets, Powerful Computers, Biopac systems, Face reader systems). Experiments and the development of new algorithms will lead to the possibility of developing a new generation of games, which are influenced in real time by eye movements, facial expressions or concentration.