ITR: A Petabyte in Your Pocket

2015年，只需每年几百美元，每个人都将拥有一个个人PB数据库(PetDB)，可以从任何连接点访问，使用从高性能工作站到PDA的任何设备。每个人的PetDB将是他们对任何地方存在的所有在线数字数据的不断发展和定制的视图。它将存储和组织任何类型的数字数据，而不会丢失结构或信息。所有这些数据都将是可查询的，并按类型、内容、结构、关联以及多种分类和分组进行排列。PetDB是使用我们称为网络数据管理器(NDM)的新一代软件基础设施可以完成的工作的一个例子。本研究的目标不是构建PetDB本身，而是设计和实现NDM技术，在此技术上可以轻松地构建PetDB和其他应用程序。NDMS与目前的数据库管理系统不同。它们专注于数据移动，而不是数据存储，并且必须处理任意类型的数据，而不一定具有匹配的数据库模式。他们必须在数以万计的信息站点上执行查询，同时监控快速变化的信息源上可能有数百万个触发器。已经对国家数据管理采取了第一批探索性步骤，初步开展了关于可扩展标记语言查询、上下文中的文本索引和搜索、多触发规划和数据流处理的工作。这项工作展示了NDM的一些基本能力。继续研究将解决必须解决的具有挑战性的根本问题，以扩大这些能力，以充分利用NDM的全部能力。同时，将通过分布式和并行实施，在用户数、任务数和站点数以及数据量方面扩大国家数据管理机构的运作规模。

In 2015, for a few hundred dollars a year, everyone will have a personal petabyte database (PetDB) that can be accessed from any point of connection, with any device from a high-powered workstation to a PDA. Each individual's PetDB will be their evolving and customized view of all the on-line digital data that exists anywhere. It will store and organize any kind of digital data, without losing structure or information. All this data will be queryable and arranged by type, content, structure, association and multiple categorizations and groupings. The PetDB is an example of what could be done with a new generation of software infrastructure we term Net Data Managers (NDMs). The object of this research is not to build a PetDB per se; but to design and implement the NDM technology upon which PetDBs and other applications could be readily built. NDMs are a departure from current database management systems. They focus on data movement, rather than data storage and must handle data of arbitrary types, without necessarily having a matching database schema. They must execute queries over tens of thousands of information sites, while monitoring possibly millions of triggers over rapidly changing information sources. The first exploratory steps have been taken towards NDMs with initial work on XML querying, text in context indexing and searching, multi-trigger planning and data stream processing. This work has demonstrated some of the basic capabilities of NDMs. Continued research will address the challenging fundamental problems that must be solved to extend these capabilities to exploit the full capabilities of NDMs. At the same time, the scale at which NDMs operate will be extended, in terms of numbers of users, tasks and sites, as well as data volumes, through distributed and parallel implementations.