File Structuring and Information Retrieval for Large Full Text Libraries

小行星9300124 这是一个为期三年的连续奖励的第一年资助。 处理大量的异构文本的文本长度和主题都有很大的不同。 在这种情况下，无法保持文件全文的完整性，但需要根据具体的用户要求，允许查阅个别文本摘录。 该项目涉及与灵活的全文环境的设计和操作有关的三个主要方面：对不受限制的主题领域的异质数据进行内容分析和文本索引;生成多种链接文本结构，其中通过文本链接可共同访问类似的文本摘录;以及在这样的结构化文本环境中实现复杂的文本利用方法。 基于语料库的文本分析方法正在开发中，基于复杂的文本匹配算法，该算法既考虑了不同文本之间现有的全局词汇一致性，又考虑了使用词汇的局部环境中的相似性。 当相似的词用在相似的地方语境中时，其含义通常是一致的。 相关文本摘录的超文本结构，然后必须在不同层次的细节，这些链接的文本结构必须用于灵活的文本遍历，识别文本主题，自动构建文本摘要和摘要。 大型结构化文本环境的可用性将极大地改善对全文集合的操作，并在文本转换和文本使用方面开辟许多应用领域。 ***

9300124 Salton This is the first year funding of a three-year continuing award. The processing of large collections of heterogeneous text is addressed where both the text lengths and the subject matter vary widely. In such circumstances, the integrity of full documents cannot be maintained, but access needs to be provided to individual text excerpts in accordance with specific user requirements. This project is concerned with three main aspects relating to the design and operations of a flexible full-text environment: the content analysis and text indexing for heterogeneous data in unrestricted subject areas; the generation of linked text structures of many kinds where similar text excerpts are jointly accessible by following the text links; and the implementation of sophisticated text utilization methods in such a structured text environment. Corpus-based text analysis methods are under development based on sophisticated text matching algorithms that account both for existing global vocabulary coincidences between different texts, and for similarities in the local environment in which the vocabulary is used. When similar words are used in similar local contexts, the meanings are normally congruent. Hypertext structures of relatable text excerpts must then be generated at various levels of detail, and these linked text structures must be utilized for flexible text traversal, and the recognition of text themes, and the automatic construction of text abstracts and summaries. The availability of large structured text environments will vastly improve the manipulation of collections of full text, and open up many areas of application in text transformation and text use. ***