Multi-Modal Spatial Querying

多模态空间查询

• 批准号: 9613646
• 负责人: Max Egenhofer
• 金额: $ 48.26万
• 依托单位: University of Maine
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 1996
• 资助国家: 美国
• 起止时间: 1996-10-01 至 2002-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9613646&HistoricalAwards=false
• 关键词: Multi; Modal; Spatial; Querying

This project investigates the use of two concurrent communication channels, graphics and speech, to achieve a successful interaction between a person and a geographic information system (GIS). The objective is to construct a multi-modal spatial query language in which users interact with a geographic database by drawing sketches of the desired configuration, while simultaneously talking about the spatial objects and the spatial relations drawn. This study will increase our understanding of multi-modal spatial interactions, and will lead to improved strategies for intelligent integration and processing of such multi-modal spatial queries in a GIS. The key to this interaction is the exploitation of complementary or redundant information present in both graphical and verbal descriptions of the same spatial scenes. A multiple-resolution model of spatial relations is used to capture the essential aspects of a sketch and its corresponding verbal description. The model stresses topological properties, such as containment and neighborhood, and considers metrical properties, such as distance and directions, as refinements where necessary. This model enables the retrieval of similar, not only exact, matches between a spatial query and a geographic database. Such new methods of multi-modal spatial querying and spatial similarity retrieval will empower experts as well as novice users to perform easier spatial searches, ultimately providing new user communities access to spatial databases.

这个项目研究了使用两个并发的通信渠道，图形和语音，以实现一个人与地理信息系统（GIS）之间的成功互动。目标是构建一种多模态空间查询语言，用户通过绘制所需配置的草图与地理数据库进行交互，同时谈论所绘制的空间对象和空间关系。这项研究将增加我们对多模态空间交互的理解，并将导致在GIS中智能集成和处理此类多模态空间查询的改进策略。这种互动的关键是利用在相同空间场景的图形和语言描述中存在的互补或冗余信息。空间关系的多分辨率模型用于捕获草图的基本方面及其相应的口头描述。该模型强调拓扑属性，如围护性和邻域性，并考虑度量属性，如距离和方向，作为必要时的细化。该模型能够检索空间查询和地理数据库之间的相似匹配，而不仅仅是精确匹配。这种多模态空间查询和空间相似性检索的新方法将使专家和新手用户能够更容易地执行空间搜索，最终为新的用户群体提供对空间数据库的访问。