DC: Large: Collaborative Research: ASTERIX: A Highly Scalable Parallel Platform for Semistructured Data Management and Analysis

由HTML和HTTP驱动的“人类网络”的发展彻底改变了人们查找信息、购买商品、交流和协作的方式。Web服务和半结构化数据格式对“机器Web”也有类似的影响。“XML正在丰富我们今天查找和交换信息的能力;行业垂直领域已经创建了基于XML的数据交换标准; XML主干已经被采用来支持面向服务的体系结构和软件即服务计划。其他半结构化格式，如JSON，也在扮演类似的角色，XML越来越多地用于其语义文档标记的最初目的。因此，世界很快就会被半结构化信息的海洋所淹没。ASTERIX项目正在开发新的技术，用于对大量的半结构化信息进行输入、存储、管理、索引、查询、分析和订阅。该项目结合了三个不同领域的想法-半结构化数据，并行数据库和数据密集型计算-以创建下一代开源软件平台，该平台通过在大型无共享计算集群上运行而扩展。ASTERIX的目标是广泛的半结构化信息，从“数据”用例（信息标记良好且高度规则）到“内容”用例（数据不规则且大部分数据都是文本）。ASTERIX在数据格式方面采取开放的立场，并致力于解决研究问题，包括高度可扩展的数据存储和索引，超大型集群上的半结构化查询处理，以及将并行数据库技术与当今的数据密集型计算技术相结合，以支持分析半结构化信息问题的高性能但声明性的解决方案。项目网站：http://asterix.ics.uci.edu/

The evolution of the "human Web," powered by HTML and HTTP, has revolutionized the way that people find information, buy things, communicate, and collaborate. Web services and semi-structured data formats are having a similar impact on the "machine Web." XML is enriching our ability to find and interchange information today; industry verticals have created XML-based data exchange standards; and XML backbones have gained adoption in support of service-oriented architectures and software-as-a-service initiatives. Other semi-structured formats, like JSON, are playing similar roles, and XML is increasingly being used for its original purpose of semantic document markup. As a result, the world will soon be awash in a sea of semi-structured information. The ASTERIX project is developing new technologies for ingesting, storing, managing, indexing, querying, analyzing, and subscribing to vast quantities of semi-structured information. The project is combining ideas from three distinct areas - semi-structured data, parallel databases, and data-intensive computing - to create a next-generation, open source software platform that scales by running on large, shared-nothing computing clusters. ASTERIX targets a wide range of semi-structured information, ranging from "data" use cases - where information is well-tagged and highly regular - to "content" use cases - where data is irregular and much of each datum is textual. ASTERIX is taking an open stance on data formats and addressing research issues including highly scalable data storage and indexing, semi-structured query processing on very large clusters, and merging parallel database techniques with today's data-intensive computing techniques to support performant yet declarative solutions to the problem of analyzing semi-structured information.Project website: http://asterix.ics.uci.edu/