Searching and Analyzing Big Data: Context-sensitive and Task-aware Approaches

搜索和分析大数据：上下文敏感和任务感知的方法

• 批准号: RGPIN-2015-03807
• 负责人: Huang, Jimmy
• 金额: $ 3.13万
• 依托单位: York University
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2017
• 资助国家: 加拿大
• 起止时间: 2017-01-01 至 2018-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=634736
• 关键词: Searching; Analyzing; Big; Data; Context

Using Google is easy. Finding information using Google is another matter. Over the decades, significant progress has been made in Information Retrieval (IR). However, IR is far from a solved problem and many challenges remain. First, most Web search engines take a short text query as input and output a ranked list of documents. The retrieval decision is made primarily based on the current query and document collection. The results for a given query are usually identical, independent of the user or the context in which the user made the request. Second, IR is an interactive process. With the current document-centered retrieval paradigm, interactive retrieval is treated as a sequence of independent simple retrieval decision making steps. However, it has been brought into attention that analysis of task-aware user sessions, which contain a sequence of requests submitted by a user to fulfill an information need, provides useful insight into the query behavior of the user. Third, most of present IR systems use keywords to query and index documents. However, this traditional keyword-based IR model provides little semantic context for the understanding of user information needs, which can lead to mismatch between query and document in search. Ideally, one would like to see the query and document match with each other, if they are topically relevant. Thus, the integration of semantic context according to the user's information need and the user's understanding of the documents into IR systems is needed to improve the IR performance. Fourth, organizations are now increasingly dealing with petabyte-scale collections of data. Context-sensitive and task-aware approaches become more challenging when dealing with big data. Hence, it is important to propose new algorithms and models that can effectively and efficiently process big data and implement the context-sensitive and task-aware approaches in big-data scenarios.

使用谷歌很容易。使用谷歌查找信息则是另一回事。几十年来，信息检索(IR)取得了长足的进步。然而，IR远未成为一个解决的问题，仍然存在许多挑战。首先，大多数Web搜索引擎将简短的文本查询作为输入，并输出排序的文档列表。检索决策主要基于当前的查询和文档集合。给定查询的结果通常是相同的，与用户或用户发出请求的上下文无关。第二，信息交流是一个互动的过程。在当前以文档为中心的检索范式下，交互式检索被视为一系列独立的简单检索决策步骤。然而，人们已经注意到，对任务感知用户会话的分析提供了对用户查询行为的有用洞察，其中任务感知用户会话包含由用户提交以满足信息需求的一系列请求。第三，目前的信息检索系统大多使用关键字来查询和索引文档。然而，这种传统的基于关键字的信息检索模型对用户信息需求的理解提供的语义上下文很少，这会导致搜索中查询和文档的不匹配。理想情况下，人们希望看到查询和文档相互匹配，如果它们是主题相关的话。因此，需要根据用户的信息需求和用户对文档的理解将语义上下文整合到信息检索系统中，以提高信息检索的性能。第四，组织现在越来越多地处理PB级的数据收集。在处理大数据时，情景敏感型和任务感知型方法变得更具挑战性。因此，提出新的算法和模型，能够有效和高效地处理大数据，并在大数据场景中实现上下文敏感和任务感知方法，具有重要意义。