III: Small: Domain-Agnostic Dataset Search

今天，网络的规模是如此之大，以至于人们无法想象没有网络搜索引擎就能找到很多信息。同样，现在可用的公共数据集的数量已经变得如此之大，以至于研究人员很难在他或她的学科中跟踪所有这些数据，而不可能在跨学科中做到这一点。为了帮助搜索者以与学科无关的方式查找数据，该项目将研究新的、有前途的全内容数据集搜索方法。这项研究将提供技术和开发一个工具的原型，最终可以帮助各种科学家找到他们可以用来进行探索性分析和测试假设的数据。因此，这项工作将使公共数据集的发现和重用成为可能，而不管数据是谁产生的，也不管数据存储在哪里。使用这些方法的数据集搜索引擎通过帮助研究人员加速他们的工作和减少重复的工作来造福社会。它也将使数据记者等其他人受益，因为数据有望成为新的证据来源和故事发现（一种讲述故事和事实核查的新方式），从而使报道既有意义又值得信赖。这项工作将帮助任何数据分析师找到相关的数据集。该项目将影响研究生和本科生的培养。这种参与将有可能扩大代表性不足的群体的参与和编写教育材料。研究人员将把这项工作的结果纳入课程，包括数据科学、网络搜索引擎、数据新闻和语义网络主题。现有的数据集搜索服务很麻烦，专注于搜索描述，而不是数据，并且迎合搜索者在他们自己的领域内寻找。该项目的目标是开发一个原型数据集搜索引擎，结合新的全内容索引技术，使搜索者能够在网络上找到数据，而不受领域的限制。研究人员将结合信息检索、数据库和数据挖掘的原理和新方法。原型的设计和开发也将采取以用户为中心的方法，让专业人员和从业人员参与观察、访谈和实验研究，为这一过程提供信息和指导。这项工作的成果包括：(1)为从数十万个真实世界的公共数据集构建搜索索引开发新的原则、方法和技术：研究人员将为a)全内容索引和分析创造新的方法；b)在缺乏现有描述符时推断额外的元数据，如属性名称；c)推断可用于解决模式和数据异构的其他描述符。(2)了解搜索者在搜索和考虑使用数据集时的认知过程。将建立一个社会认知模型来描述数据集搜索中的人-系统交互，并预测系统在各种场景下的有效性。(3)开发新的接口，以支持对这些用户的数据集的搜索、探索和呈现。通过这一过程，研究人员将开发一套从用户角度评估数据集搜索技术和界面的工具。研究成果将通过在会议和期刊上发表和发表、在网络上分享、进行演讲和使开发的软件开源等方式广泛传播。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Today, the size of the Web is such that one cannot imagine finding much information without a web search engine. Similarly, the number of collections of public datasets now available has become so large as to be difficult for a researcher to track all of them within his or her discipline, and impossible to do so across disciplines. To help searchers find data in a discipline-agnostic manner, this project will investigate new, promising approaches to full-content dataset search. This research will provide the technology and develop the prototype of a tool that can ultimately assist many kinds of scientists to locate data that they can use to perform exploratory analysis and test hypotheses. Thus, this work will enable public dataset discovery and reuse, regardless of who produced the data or where it is stored. A dataset search engine using these methods benefits society by helping researchers to accelerate their work and reduce duplicate efforts. It will also benefit others, such as data journalists, as data promises a new source of evidence and for story discovery, a new way for story-telling and fact-checking, to make reporting that is both meaningful and trustworthy. This work will help any data analyst locate relevant datasets. This project will impact the training of graduate students and undergraduates. This involvement will make it possible to broaden participation by underrepresented groups and the development of educational materials. The researchers will incorporate results of this work in courses, including Data Science, Web Search Engines, Data Journalism, and Semantic Web Topics. Existing dataset search services are cumbersome, focusing on searching descriptions, not data, and cater to searchers looking within their own discipline. The project's goal is to develop a prototype dataset search engine incorporating new techniques for full-content indexing to enable searchers to find data across the web, regardless of domain. The investigators will combine principles and novel methods from information retrieval, databases, and data mining. The design and development of the prototype will also take a user-centric approach, involving professionals and practitioners in observational, interview and experimental studies to inform and guide this process. The outcomes of this work include: (1) The development of new principles, methods, and technologies for the construction of search indexes from hundreds of thousands of real-world public datasets: the researchers will create novel methods for a) full-content indexing and analysis, b) inferring additional metadata such as attribute names when the existing descriptors are lacking and, c) inferring additional descriptors that can be used to resolve schema and data heterogeneity. (2) The understanding of searchers' cognitive processes as they search for and consider use of datasets. A social cognitive model will be built to describe human-system interactions in dataset searches, and to predict the effectiveness of the system in various scenarios. (3) The development of novel interfaces to support the search, exploration, and presentation of datasets to such users. Through this process, the researchers will develop a set of instruments for evaluating the dataset search technology and interface from the user's perspective. Research results will be disseminated broadly by presenting and publishing at conferences and journals, sharing on the web, giving talks, and making developed software open source.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.