Building an end-to-end BAD application
Building an end-to-end BAD application
复制标题
DOI：
10.1145/3465480.3467840
复制
发表时间：
2021-06
期刊：
影响因子：
--
通讯作者：
Shahrzad Haji Amin Shirazi;M. Carey;V. Tsotras
中科院分区：
文献类型：
--
作者：
Shahrzad Haji Amin Shirazi;M. Carey;V. Tsotras
传统的大数据基础设施本质上是被动的，被动地响应用户处理和返回数据的请求。然而，在许多应用程序中，用户不仅需要分析数据，还需要根据他们的订阅订阅和主动接收感兴趣的数据。他们的兴趣可能包括传入数据的内容及其与其他数据的关系。此外，交付给订阅者的数据可能需要添加其他相关和可操作的信息。为了应对这一大活动数据（BAD）挑战，我们提倡构建可扩展的BAD系统，以持续可靠地捕获大数据，同时能够及时、自动地向大量订阅者提供相关的、可能丰富的信息。在本演示中，我们将展示如何使用BAD系统和用于数据传递的标准电子邮件代理构建端到端活动应用程序。这包括允许用户在坏系统中注册他们的兴趣，摄取和监视数据，生成定制的结果并将其交付给适当的订阅者。通过这个示例，我们演示了即使是复杂的活动数据应用程序也可以很容易地创建，并且可以扩展到许多用户，如果采用BAD方法，将大大限制应用程序开发人员的工作。
Traditional big data infrastructures are passive in nature, passively answering user requests to process and return data. In many applications however, users not only need to analyze data, but also to subscribe to and actively receive data of interest, based on their subscriptions. Their interest may include the incoming data's content as well as its relationships to other data. Moreover, data delivered to subscribers may need to be enriched with additional relevant and actionable information. To address this Big Active Data (BAD) challenge we have advocated the need for building scalable BAD systems that continuously and reliably capture big data while enabling timely and automatic delivery of relevant and possibly enriched information to a large pool of subscribers. In this demo we showcase how to build an end-to-end active application using a BAD system and a standard email broker for data delivery. This includes enabling users to register their interests with the bad system, ingesting and monitoring data, and producing customized results and delivering them to the appropriate subscribers. Through this example we demonstrate that even complex active data applications can be created easily and scale to many users, considerably limiting the effort of application developers, if a BAD approach is taken.