MRI: Development of a Gesture Based Virtual Reality System for Research in Virtual Worlds

MRI：开发基于手势的虚拟现实系统，用于虚拟世界的研究

• 批准号: 0923158
• 负责人: Horea Ilies
• 金额: $ 78.2万
• 依托单位: University of Connecticut
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-07-15 至 2015-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0923158&HistoricalAwards=false
• 关键词: MRI; Development; Gesture; Based; Virtual

Proposal #: CNS 09-23158PI(s): Ilies, Horea T.; Anderson, Amy; Kazerounian, Kazem; Marsh, Kerry L.; Nowak, KristineInstitution: University of ConnecticutTitle: MRI/Dev.: Dev. of a Gesture Based Virtual Reality System for Research in Virtual WorldsProject Proposed:This project, developing an integrated virtual environment system capable of allowing not only 3D visualization of data, but also interaction with data through natural hand and finger gestured based on a dual interface, exploits a multi-touch interaction interface and a vision based hand-gesture interface. Virtual reality environments rely on a collection of technologies that allow the user to go through a coherent and unified perceptual experience involving multiple senses, such as vision, touch, and sound, while interacting with 3-dimensional data. These immersive, highly visual, 3D environments currently offer a fairly high level of performance for spatially visualizing data. However, the corresponding machinery providing user interaction with these systems has not kept up the same pace of development with the visualization tools. At present some advanced commercial environments offer some user interaction capabilities achieved through wired wearable hardware (such as wired gloves and head mounted displays). This promotes, in turn, an unnatural and cumbersome interaction between the user and the virtual reality environments, curbing the acceptance of the technologies. The syntax and semantics of the hand and finger gestures developed interacts with geometric data, while the implementation relies on the Multi-Touch Surface computing platform as well as on a newly developed gesture tracking and recognition system. The environment should lead to a potent open platform for interacting with virtual geometric data in an intuitive way, without the need for wearable hardware galvanizing the state of the art at the institution in Nano and Design Engineering, Psychology, Computer Science, Structural biology, as well as support research in the Center for Health, Intervention, and Prevention (CHIP). This project addresses the problem.Broader Impacts: This instrumentation will be open source and widely available with well documented set up procedures. The VR system will be networked with other VR-sites, including VRAC at Iowa State, to maximize the impact and stimulate technology transfer. Moreover, the instrument contributes to- Stimulate critical avenues of interdisciplinary research involving engineering, biology, computer science, psychology, and Human Computer Interaction (HCI),- Strengthen the potential for educational, student recruiting, and outreach activities, and- Perform targeted outreach to K-12 students, teachers, and school districts serving groups that have traditionally been underrepresented in the engineering disciplines. The project also advances the state of the art in the teaching and practice of engineering design, as well as other fields in which geometry plays and important role. Contributing to the development of a new generation of professionals that use capabilities of virtual reality tools to augment traditional disciplines for improved engineering design, this work should have a long-lasting impact on the ability of scientists and engineers.

提案号：CNS 09-23158PI(s): Ilies, Horea T.；安德森,艾美;Kazerounian Kazem;克里·l·马什；机构：康涅狄格大学头衔：MRI/Dev项目建议：本项目开发一个集成的虚拟环境系统，不仅可以实现数据的三维可视化，还可以通过基于双界面的自然手势和手指手势与数据进行交互，利用多点触摸交互界面和基于视觉的手势界面。虚拟现实环境依赖于一系列技术，这些技术允许用户在与三维数据交互的同时，经历涉及视觉、触觉和声音等多种感官的连贯统一的感知体验。这些沉浸式的、高度可视化的3D环境目前为空间可视化数据提供了相当高的性能水平。然而，为这些系统提供用户交互的相应机制并没有跟上可视化工具的发展步伐。目前，一些先进的商业环境提供了一些通过有线可穿戴硬件（如有线手套和头戴式显示器）实现的用户交互功能。这反过来又促进了用户和虚拟现实环境之间不自然和繁琐的交互，抑制了技术的接受。所开发的手部和手指手势的语法和语义与几何数据相互作用，而实现依赖于Multi-Touch Surface计算平台以及新开发的手势跟踪和识别系统。该环境应该导致一个强大的开放平台，以直观的方式与虚拟几何数据进行交互，而不需要可穿戴硬件来激发纳米与设计工程、心理学、计算机科学、结构生物学等机构的最新技术，以及健康、干预和预防中心（CHIP）的支持研究。这个项目解决了这个问题。更广泛的影响：该仪器将是开源的，并且具有良好文档的设置过程可以广泛使用。虚拟现实系统将与其他虚拟现实站点联网，包括爱荷华州立大学的虚拟现实研究中心，以最大限度地发挥影响并促进技术转让。此外，该工具有助于-激发涉及工程，生物学，计算机科学，心理学和人机交互（HCI）的跨学科研究的关键途径，-加强教育，学生招募和外展活动的潜力，以及-对传统上在工程学科中代表性不足的K-12学生，教师和学区进行有针对性的外展。该项目还推进了工程设计教学和实践的艺术状态，以及其他几何发挥重要作用的领域。促进新一代专业人士的发展，利用虚拟现实工具的能力来增强传统学科的改进工程设计，这项工作应该对科学家和工程师的能力产生持久的影响。