Multisensory immersive media and next-generation applications

点击翻译按钮获取中文摘要

Immersive communication aims to enable natural experiences and interactions with remote people and environments in ways that blur the line between real and virtual environments. Today, our need for more effective ways to communicate with remote people has never been greater. Existing immersive technologies and applications, however, rely only on two senses: vision and hearing. To enable true immersive communications, we need to involve other senses, such as olfaction, touch, and thermo(re)ception. Imagine yourself watching a movie where you feel the heat from an explosion; a videogame where you can feel the wind in your face as you are driving; TV ads where you can smell the food; multisensory virtual therapy for individuals with anxiety; or a videoconference, where you can "touch" the person on the other side of the call. In fact, Ericsson's ConsumerLab suggests that upcoming technological advances will move us from a screen-based world to a sense-based world by 2030. It is envisioned that the Internet of Things will become the Internet of Senses where mind, touch, smells, taste, sight and sound will all come together with the help of emerging 5G networks and Tactile Internet innovations. Canada, despite being known worldwide for innovations in virtual reality (VR), falls far behind Europe, for example, when it comes to multisensory immersive media research. This proposal aims to fill this gap. We request funds to purchase a multisensory immersive virtual reality booth - the first in Canada for research purposes. It is portable, wheelchair accessible, and comprises a programmable interface in which scents, hot/cold air, arm gestures, haptic feedback, immersive audio, and VR content can be presented for research purposes. This fundamental component will enable a new line of research in Canada, that of multisensory immersive media. When coupled with our award-winning instrumented virtual reality headset and user-aware human factor metrics for quality-of-experience monitoring, applications across multiple verticals will be developed that are optimized for each user. Within the healthcare sector, applications such as multisensory anxiety therapeutics and Alzheimer's disease diagnosis will be explored. For defense, it will enable next-generation training of soldiers and pilots in high-risk situations. For the entertainment sector, new paradigms in gaming, gamer experience, and remote tourism will be enabled. The requested equipment will not only open up a new research frontier for Canada, but will also expose existing and incoming highly qualified personnel to a highly interdisciplinary topic, thus providing young researchers with invaluable cross-disciplinary expertise in domains that are highly sought-after in the marketplace. Represenatative examples include human factors, immersive media, signal processing, serious gaming, neuropsychology, healthcare 4.0, information fusion, big data, and machine learning, to name a few.