Foofah: Transforming Data By Example
Foofah: Transforming Data By Example
复制标题
Foofah：通过示例转换数据
DOI：
10.1145/3035918.3064034
复制
发表时间：
2017
期刊：
影响因子：
--
通讯作者：
H. V. Jagadish
中科院分区：
文献类型：
--
作者：
Zhongjun (Mark) Jin;Michael R. Anderson;Michael J. Cafarella;H. V. Jagadish
数据转换是现代数据分析中至关重要的第一步：在进行任何分析之前，必须将来自各种来源的数据整理成统一的格式，以便适用于预期的分析和分析软件包。这种数据转换任务是乏味的，耗时的，并且通常需要超出数据分析师专业知识的编程技能。在本文中，我们开发了一种技术来合成数据转换程序的例子，减少这种负担，让分析师描述的转换与一个小的输入输出的例子对，而不关心的转换步骤需要到那里。我们在一个系统中实现了我们的技术，FOOFAH，有效地搜索可能的数据转换操作的空间，以生成一个程序，将执行所需的转换。我们的实验表明，数据转换程序可以快速创建FOOFAH的各种情况下，与60%的用户工作量比著名的WRANGLER系统。
Data transformation is a critical first step in modern data analysis: before any analysis can be done, data from a variety of sources must be wrangled into a uniform format that is amenable to the intended analysis and analytical software package. This data transformation task is tedious, time-consuming, and often requires programming skills beyond the expertise of data analysts. In this paper, we develop a technique to synthesize data transformation programs by example, reducing this burden by allowing the analyst to describe the transformation with a small input-output example pair, without being concerned with the transformation steps required to get there. We implemented our technique in a system, FOOFAH, that efficiently searches the space of possible data transformation operations to generate a program that will perform the desired transformation. We experimentally show that data transformation programs can be created quickly with FOOFAH for a wide variety of cases, with 60% less user effort than the well-known WRANGLER system.