TelegraphCQ: continuous dataflow processing
TelegraphCQ: continuous dataflow processing
复制标题
DOI:
10.1145/872757.872857
复制
发表时间:
2003-06
期刊:
影响因子:
--
通讯作者:
Sirish Chandrasekaran;Owen Cooper;A. Deshpande;M. Franklin;J. Hellerstein;W. Hong;S. Krishnamurthy;S. Madden;Frederick Reiss;Mehul A. Shah
中科院分区:
文献类型:
--
作者:
Sirish Chandrasekaran;Owen Cooper;A. Deshpande;M. Franklin;J. Hellerstein;W. Hong;S. Krishnamurthy;S. Madden;Frederick Reiss;Mehul A. Shah
At Berkeley, we are developing TelegraphCQ [1, 2], a dataflow system for processing continuous queries over data streams. TelegraphCQ is based on a novel, highly-adaptive architecture supporting dynamic query workloads in volatile data streaming environments. In this demonstration we show our current version of TelegraphCQ, which we implemented by leveraging the code base of the open source PostgreSQL database system. Although TelegraphCQ differs significantly from a traditional database system, we found that a significant portion of the PostgreSQL code was easily reusable. We also found the extensibility features of PostgreSQL very useful, particularly its rich data types and the ability to load user-developed functions. Challenges: As discussed in [1], sharing and adaptivity are our main techniques for implementing a continuous query system. Doing this in the codebase of a conventional database posed a number of challenges: