Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social Media

Project Geollery.com: Reconstructing A Live Mirrored World With Geotagged Social Media
复制标题

DOI:
10.1145/3329714.3338126
复制
发表时间:
2019-07
期刊:
Proceedings of the 24th International Conference on 3D Web Technology
影响因子:
--
通讯作者:
Ruofei Du;David Li;A. Varshney
Ruofei Du;David Li;A. Varshney
中科院分区:
其他
文献类型:
--
作者:
Ruofei Du;David Li;A. Varshney

文献摘要

相似文献

虚拟现实中的社交媒体是一个高增长的细分市场,在虚拟旅游,远程教育和商务会议方面拥有有影响力的产品和服务。然而,先前的系统从未实现过在线平台,该在线平台利用真实的地理标记的社交媒体来呈现6DoF镜像世界。在本文中,我们介绍了Geollery.com背后的技术细节,它在两个细节层次上重建了镜像世界。给定一对纬度和经度坐标,我们的管道流和缓存深度图,街景贴图,以及来自Google Maps和OpenStreetMap API的建筑多边形。在一个精细的细节水平的特写视图,我们渲染纹理网格使用相邻的本地街景和深度图。当从远处观看时,我们将投影映射应用于从建筑多边形挤出的3D几何形状,以获得粗略的细节。与远距离传送相比,我们的系统允许用户在街道上虚拟地穿过镜像世界。我们的系统集成了来自内部用户和外部来源(如Twitter,Yelp和Flicker)的地理标记社交媒体。我们在各种平台上验证了Geollery.com的实时策略,包括移动的电话、工作站和头戴式显示器。
Social media in virtual reality is in a high-growth market segment with influential products and services in virtual tourism, remote education, and business meetings. Nevertheless, previous systems have never achieved an online platform which renders a 6DoF mirrored world with geotagged social media in real time. In this paper, we introduce the technical detail behind Geollery.com which reconstructs a mirrored world at two levels of detail. Given a pair of latitude and longitude coordinates, our pipeline streams and caches depth maps, street view panoramas, and building polygons from Google Maps and OpenStreetMap APIs. At a fine level of detail for close-up views, we render textured meshes using adjacent local street views and depth maps. When viewed from afar, we apply projection mappings to 3D geometries extruded from building polygons for a coarse level of detail. In contrast to teleportation, our system allows users to virtually walk through the mirrored world at the street level. Our system integrates geotagged social media from both internal users and external sources such as Twitter, Yelp, and Flicker. We validate our real-time strategies of Geollery.com on various platforms including mobile phones, workstations, and head-mounted displays.