Sensorizer: an architecture for regenerating cyber physical data streams from the web
Sensorizer: an architecture for regenerating cyber physical data streams from the web
复制标题
Sensorizer：一种从网络重新生成网络物理数据流的架构
DOI：
10.1145/2800835.2801627
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
Takuro Yonezawa
中科院分区：
文献类型：
--
作者：
J. Nakazawa;H. Tokuda;Takuro Yonezawa
万维网包含大量最初从物理世界感知到的定期更新的值；例如，它们包括空气污染物的密度、道路交通状况和停车场占用率。然而，在许多情况下，由于缺乏获取这些数据的 API，计算机程序无法轻松访问这些数据。在本文中，为了解决这个问题，我们提出了一种用于发现、挖掘和流式传输隐藏网页内容（EWC）的架构。这种架构称为 Sensorizer，利用众包进行准确的 EWC 发现、使用无头浏览器定期进行网页抓取以从动态网页中进行挖掘，以及将数据流式传输到各种应用程序的标准化通信协议 (XMPP)。
World Wide Web contains a huge amount of periodically-updated values originally sensed from the physical world; they include, for example, density of air pollutant, road traffic condition, and car park occupancy. In many cases, however, those data are not easily accessible from a computer program due to the lack of APIs to fetch them. In this paper, to cope with this problem, we propose an architecture for discovering, excavating, and streaming the entombed web contents (EWC). This architecture, called Sensorizer, leverages crowd sourcing for accurate EWC discovery, periodic web scraping with a headless browser for excavation from dynamic web pages, and a standardized communication protocol (XMPP) for data streaming to wide variety of applications.