ITR/SY: Electronic Books for the Tele-immersion Age: A New Paradigm for Teaching Surgical Procedures

ITR/SY：远程沉浸时代的电子书：外科手术教学的新范式

• 批准号: 0121657
• 负责人: Andries van Dam
• 金额: $ 175万
• 依托单位: Brown University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2001
• 资助国家: 美国
• 起止时间: 2001-09-01 至 2005-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0121657&HistoricalAwards=false
• 关键词: ITR; SY; Electronic; Books; Tele

Tele-immersion will provide a dramatic new medium for groups of people remote from each other to work and share experiences together in an immersive 3D virtual environment, much as if they were co-located in a shared physical space. Immersive electronic books that in effect blend a "time machine" with 3D hypermedia, will add an additional important dimension, that of being able to record experiences in which a viewer, immersed in the 3D reconstruction, can literally walk through the scene or move backward and forward in time. While there are many potential application areas for such novel technologies (e.g., design and virtual prototyping, maintenance and repair, paleontological and archaeological reconstruction), the focus here will be on a societally important and technologically challenging driving application, teaching surgical management of difficult, potentially lethal, injuries. Today, the pace of surgical innovations has increased dramatically, yet the mechanisms for training and re-training suffer from inflexible timing, extended time commitments, and limited content. Traditional videotaped instruction has long been available to help surgeons learn new procedures, but this approach is only marginally effective due to the fixed point of view that is integral to the narration, lack of depth perception and interactivity, and missing information; in short, the experience of watching a video is not sufficiently close to being there and seeing the procedure. In this project the PI will develop a new paradigm for teaching surgical procedures that allows surgeons to witness and explore (in time and space) a past surgical procedure as if they were there, with the added benefit of instruction from the original surgeon or another instructor, as well as integrated 3D illustrations, annotations, and relevant medical metadata. The trainees should be able to freely and naturally walk around a life-sized, high-fidelity, 3D graphical reconstruction of the original time-varying events, pausing or stepping forward and backward in time to satisfy curiosity or allay confusion. To make this reality, the PI and his team bring together experts in several disciplines, and will be able to collectively leverage their prior work in tele-immersion, time-varying 3D scene capture, interaction metaphors, "cinematic" techniques. and authoring tools.

远程沉浸将为彼此远离的人群提供一种戏剧性的新媒介，让他们在沉浸式3D虚拟环境中一起工作和分享经验，就像他们共同位于一个共享的物理空间中一样。 沉浸式电子书实际上将“时间机器”与3D超媒体融合在一起，将增加一个额外的重要维度，即能够记录体验，其中沉浸在3D重建中的观众可以真正地穿过场景或在时间中前后移动。 虽然这种新技术有许多潜在的应用领域（例如，设计和虚拟原型，维护和维修，古生物学和考古重建），这里的重点将是一个社会上重要的和技术上具有挑战性的驾驶应用，教学手术管理困难，可能致命的伤害。 今天，外科创新的步伐已经大大加快，但培训和再培训的机制受到时间不灵活，时间承诺延长和内容有限的影响。 传统的录像指导长期以来一直可用于帮助外科医生学习新的手术，但这种方法的效果有限，因为固定的视角是叙述的组成部分，缺乏深度感知和互动性，以及缺少信息;简而言之，观看视频的体验与现场和看到手术的体验不够接近。 在这个项目中，PI将开发一种新的外科手术教学模式，使外科医生能够见证和探索（在时间和空间上）过去的外科手术，就像他们在那里一样，并从原始外科医生或其他讲师的指导中获得额外的好处，以及集成的3D插图，注释和相关的医疗元数据。 学员应该能够自由和自然地在原始时变事件的真人大小，高保真，3D图形重建中走动，暂停或向前和向后走动，以满足好奇心或减轻困惑。 为了实现这一目标，PI和他的团队汇集了多个学科的专家，并将能够共同利用他们在远程沉浸，时变3D场景捕捉，交互隐喻，“电影”技术方面的先前工作。和创作工具。