Improving Recommending and Understanding Schemas and Their Provenance

我们正淹没在数据的海洋中。过去依赖于其他技能的工作现在越来越依赖于解释、理解和信任数据的能力。例如，许多生物学家现在花更少的时间在实验室，更多的时间试图分析他们创造的数据。由于创建数据的工具不断改进，越来越多的人希望他们自己管理和理解这些数据。不幸的是，即使对该领域的专家来说，这些数据通常也非常难以理解和信任。这有很多原因。一个原因是数据的表示通常是为计算机而不是人为设计的（即存储，而不是可访问性）。另一个原因是，用户可能会花费大量时间使用来自多个来源的数据组合的系统，这使得他们在集成他们既不理解也不信任的数据时遇到麻烦。

We are drowning in a sea of data. Increasingly, jobs that used to rely on other skills now rely on the ability to interpret, understand, and trust data. For example, many biologists now spend less time in the lab and more time trying to analyze the data that they have created. Increasingly, thanks to improved tools for creating data, they are expected to manage and understand this data by themselves. Unfortunately, this data is often exceedingly difficult to understand and trust, even for experts in the field. There are many reasons for this. One reason is that the representation of the data is often designed for computers, not for people (i.e., storage, not accessibility). Another reason for this is that users may spend a lot of time using systems where data is combined from multiple sources, leaving them stuck having trouble integrating data that they neither understand nor trust. The lack of understanding and trust can cause problems both large and small. For example, the recent financial crisis was partially caused by the inability to track money across multiple sources (e.g., mutual funds are in a different database than savings accounts). Because it was impossible to understand and trust the data that was spread across various sources, regulators did not realize some of the problematic flows of money until after the crash. On a smaller scale, without being able to find all of the data needed in order to evaluate building design choices, it is impossible to easily explore building design alternatives, which leads to stifled innovation and less--efficient buildings. My proposed research will improve the ability of users to access data that they need and trust that this data is well curated enough to do what they need it to do. This will build on my current work that has looked at case studies in economic data and civil engineering, and will work with the techniques that I have learned in working with recommender systems to help recommend data items to users. In this proposal I describe a number of specific directions that I intend to work on with my students in that space, including: (1) using query logs to help recommend parts of the data that users may be interested in; (2) helping users understand the complex connections that appear in XML files; and (3) improving the understanding of provenance data.