Adding Domain Knowledge to Inductive Learning Methods for Classifying Texts

本研究的目的是研究将背景知识集成到机器学习方法中，以实现文本文档的自动索引。对于案例是文本的领域，已经开发了基于案例的推理模型，以利用过去的经验。人工编制案件索引的高昂成本阻碍了大型系统的开发和维护，以便在法律、道德或服务台环境中应用。从少量带注释的案例摘要中学习文本分类器的新方法将自动对大量案例进行分类，这些方法可以帮助克服这一知识获取瓶颈。其他地方使用的文本学习算法不适用，因为它们需要大量的训练集。在这里，使用了关于领域的背景知识和对示例的语言分析来开发更好的示例表示，这将允许学习算法更好地从小的文本案例集合中进行概括。该项目还将更好地理解什么是用于学习和分类的良好文本表示，以及添加背景知识和自然语言处理工具的效果。这些实验是基于一个定义明确的领域中相对较小的集合，在这个领域，PI和他的团队积累了大量的专业知识。这种独特的背景允许对实验结果进行比通常情况下更全面的分析。在一组标记摘要和相应的全长文档上对分类器进行评估。进一步的实验探索了看不见的和未标记的案例的使用，并解释了观察到的行为。实验的结果和分析将有助于其他领域的研究人员提高文本案例的表示能力。因此，研究结果不仅对基于案例的推理和机器学习有意义，而且对信息检索和其他基于文本的应用也有重要意义。

The objective of this research is to investigate the integration of background knowledge into a machine learning approach for automatically indexing text documents. Case-Based Reasoning models for utilizing past experiences have been developed for domains where the cases are text. The prohibitive cost of manually indexing cases has hindered the development and maintenance of large systems for applications in the law, ethics, or help-desk settings. New methods that learn a text classifier from a small collection of annotated case summaries, which will classify large numbers of cases automatically, can help overcome this knowledge-acquisition bottleneck. Text learning algorithms used elsewhere are not applicable because they require large training sets. Here, background knowledge about the domain and a linguistic analysis of the examples is employed to develop a better representation of the examples, which will allow learning algorithms to better generalize from small collections of text cases. The project will also yield a better understanding of what makes a good text representation for learning and classification, and the effects of adding background knowledge and natural language processing tools. The experiments are based on a relatively small collection in a well-defined domain, in which the PI and his group have accumulated significant expertise. This unique background allows a more thorough analysis of the experimental results than generally performed. The classifier is evaluated both on a set of marked-up summaries and the corresponding full-length documents. Further experiments explore the use of unseen and unlabeled cases, and explain the observed behavior. The results and the analysis of the experiments will enable researchers in other domains to improve the representation of text cases. Thus, the research results will not only be relevant for case-based reasoning and machine learning, but also for information retrieval and other text-based applications.