Enabling and Leveraging whole-chassis sensing in VR, AR, and Handhelds

点击翻译按钮获取中文摘要

This project seeks to develop fundamentally new user interface software, built to take advantage of capacitive sensors capable of detecting detailed hand postures on and around electronic devices. The partner organization's innovative technologies create a unique opportunity to answer the question: can increased sensing of hand and finger position enable more immersive experiences? This project seeks an answer to this for each of three unique form factors: virtual reality controllers, augmented reality controllers, and handheld devices. The resulting technology will enable Tactual and its clients to fundamentally change the way humans interact with various technologies, while at the same time generating new bodies of knowledge in HCI, and producing significant HQP. The partner is Tactual Labs, a fabless semiconductor company focused on developing fundamentally better human input sensing. The technology used in this project is able to eliminate all latency from computers, tablets, digital whiteboards, virtual reality controllers, and other interactive systems. These fast devices are orders of magnitude more performant than traditional tech, at similar cost. The project will be conducted in phases. First, a methodology will be applied identifying opportunities for the unique hardware, in terms of human perception, motor skills, and context of use. Next, user interface software will be developed which take these into account, and which leverage Tactual's uniquely performant systems. These interfaces will undergo significant iterative refinement, before finally delivering three sets of unique user interface components built in software, which, when paired with Tactual's hardware, provide for fundamentally better user experiences with a wide array of form factors.