Plenario: An Open Data Discovery and Exploration Platform for Urban Science
Plenario: An Open Data Discovery and Exploration Platform for Urban Science
复制标题
Plenario：城市科学的开放数据发现和探索平台
DOI：
--
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
Ian T Foster
中科院分区：
文献类型：
--
作者：
C. Catlett;T. Malik;B. Goldstein;Jonathan Giuffrida;Yetong Shao;Alessandro Panella;Derek Eder;E. V. Zanten;R. Mitchum;S. Thaler;Ian T Foster
在过去的十年中，各种规模的政府机构和公共机构广泛发布了有关城市服务、条件和活动的开放数据。数百个开放的数据门户现在托管着数千个不同类型的数据集。这些新的数据源代表了提高对城市动态和过程的理解的巨大潜力，并最终成为更宜居、高效和繁荣的社区。然而，那些寻求实现这一潜力的人很快就会发现，由于分散的存储、异构的格式和糟糕的文档，发现和应用与任何特定问题相关的数据可能非常困难。在这种情况下，我们介绍Plenario，这是一个旨在自动化与发现，探索和应用开放城市数据相关的耗时任务的平台，并且在这样做的过程中，减少了研究人员，政策制定者，服务提供商，记者和普通公众使用数据的障碍。主要创新包括：地理空间数据仓，可将来自多个来源的数据登记到一个共同的空间和时间框架;简单直观的界面，可快速发现和探索与特定地区和时间有关的数据子集，而不论其类型和来源如何;可方便地导出这些数据子集以供进一步分析;一个用户可配置的数据摄取框架，用于自动导入和定期更新新数据集到数据仓库中;云托管，用于弹性扩展和快速创建新的Plenario实例;以及一个开源实现，以支持社区贡献。我们在这里描述了Plenario平台的架构和实现，讨论了几个社区使用它的经验教训，并概述了未来工作的计划。版权所有2014 IEEE.允许个人使用这些材料。但是，出于广告或促销目的或创建新的集体作品以转售或重新分发到服务器或列表，或在其他作品中重新使用本作品的任何受版权保护的组件，必须获得IEEE的许可。IEEE计算机学会数据工程技术委员会通报
The past decade has seen the widespread release of open data concerning city services, conditions, and activities by government bodies and public institutions of all sizes. Hundreds of open data portals now host thousands of datasets of many different types. These new data sources represent enormous potential for improved understanding of urban dynamics and processes—and, ultimately, for more livable, efficient, and prosperous communities. However, those who seek to realize this potential quickly discover that discovering and applying those data relevant to any particular question can be extraordinarily difficult, due to decentralized storage, heterogeneous formats, and poor documentation. In this context, we introduce Plenario, a platform designed to automating time-consuming tasks associated with the discovery, exploration, and application of open city data—and, in so doing, reduce barriers to data use for researchers, policymakers, service providers, journalists, and members of the general public. Key innovations include a geospatial data warehouse that allows data from many sources to be registered into a common spatial and temporal frame; simple and intuitive interfaces that permit rapid discovery and exploration of data subsets pertaining to a particular area and time, regardless of type and source; easy export of such data subsets for further analysis; a user-configurable data ingest framework for automated importing and periodic updating of new datasets into the data warehouse; cloud hosting for elastic scaling and rapid creation of new Plenario instances; and an open source implementation to enable community contributions. We describe here the architecture and implementation of the Plenario platform, discuss lessons learned from its use by several communities, and outline plans for future work. Copyright 2014 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering