MTMR: A conceptual interior design framework integrating Mixed Reality with the Multi-Touch tabletop interface
MTMR: A conceptual interior design framework integrating Mixed Reality with the Multi-Touch tabletop interface
复制标题
DOI：
10.1109/ismar.2010.5643606
复制
发表时间：
2010-11
期刊：
影响因子：
--
通讯作者：
Dong Wei;S. Zhou;Du Xie
中科院分区：
文献类型：
--
作者：
Dong Wei;S. Zhou;Du Xie
本文介绍了一种概念性室内设计框架——多点触控混合现实（MTMR），它将混合现实与多点触控桌面界面相结合，为用户提供直观高效的协作设计界面和增强的3D视图。在此框架下，多名设计师可以在桌面上显示的俯视图上同时进行设计工作，同时通过将虚拟 3D 家具模型叠加到 2D 虚拟家具模型上来捕捉和增强正在进行的设计工作的实时视频，并显示在桌面前面的垂直屏幕上。同时，远程客户端的物理房间摄像头视图会随着室内设计布局实时增强，即当设计师在桌面上放置、移动和修改虚拟家具模型时，客户端通过屏幕上的摄像头视图看到相应真人大小的3D虚拟家具模型在物理房间中驻留、移动和变化。通过采用MTMR（我们认为这也可能适用于其他类型的协作工作），设计师可以期待在自然性和直观性方面获得良好的工作体验，而客户可以参与设计过程并查看设计结果，而无需在沉重的家具周围移动。通过提出 MTMR，我们希望通过桌面界面上的多点触控输入为混合现实系统提供可靠且精确的徒手交互。
This paper introduces a conceptual interior design framework - Multi-Touch Mixed Reality (MTMR), which integrates mixed reality with the multi-touch tabletop interface, to provide an intuitive and efficient interface for collaborative design and an augmented 3D view to users at the same time. Under this framework, multiple designers can carry out design work simultaneously on the top view displayed on the tabletop, while live video of the ongoing design work is captured and augmented by overlaying virtual 3D furniture models to their 2D virtual counterparts, and shown on a vertical screen in front of the tabletop. Meanwhile, the remote client's camera view of the physical room is augmented with the interior design layout in real time, that is, as the designers place, move, and modify the virtual furniture models on the tabletop, the client sees the corresponding life-size 3D virtual furniture models residing, moving, and changing in the physical room through the camera view on his/her screen. By adopting MTMR, which we argue may also apply to other kinds of collaborative work, the designers can expect a good working experience in terms of naturalness and intuitiveness, while the client can be involved in the design process and view the design result without moving around heavy furniture. By presenting MTMR, we hope to provide reliable and precise freehand interactions to mixed reality systems, with multi-touch inputs on tabletop interfaces.