Construction of large scale annotated corpus and its management system

自80年代中期以来，基于大规模语言数据的自然语言处理已成为这一领域的主流。在这类研究中，语言资源起着重要的作用，人们已经做了很多尝试来创建各种各样的资源。本研究的目的是建立一个大规模的日语句法标注语料库的环境。为了实现这一目标，我们进行了以下几个方面的研究：2000年，我们建立了一个注释工具，支持用户以交互的方式注释句子的句法结构。该工具与现有的解析器一起工作，用户可以有效地从大量解析器的输出中选择正确的语法结构。此外，该工具具有通过建议选择顺序来导航用户的能力。在2001年，我们从日本现存最大的EDR语料库中提取了语法规则 ...更多信息 这只海狸鼠EDR语料库的缺点是缺少语料库注释所基于的语法。为此，我们首先从EDR语料库中自动抽取语法，并对其进行改进，使语法的歧义尽可能小，同时提出了一个新的语义知识构建框架，该框架不仅在语义分析中起重要作用，而且在句法分析中也起重要作用。从零开始建立语义知识是困难的，因此我们采取了一种联合收割机结合现有语义知识的方法。此外，我们还构建了一个标注语料库管理系统。该系统允许用户高效地检索各种句法结构。为了验证上述研究结果，我们建立了一个约2万句的日语语料库。这组句子摘自EDR语料库。该语料库是基于从EDR语料库中提取的语法，并在本项目中进行了改进。使用本项目开发的标注工具对语料库进行标注，并由上述系统对生成的语料库进行管理。少

Since the middle of 1980's, natural language processing based on a large scale linguistic data has become a main stream in this research area. For this kind of research, linguistic resources play important role, and there has been many attempts to create various kinds of resources. This research project aims to construct an environment to create syntactically annotated Japanese corpora in large scale. To achieve this goal, we conducted the research in the following topics.In 2000, we built an annotation tool which supports a user to annotate syntactic structure on sentences in interactive way. This tool works with an existing parser and the user cab efficiently select a correct syntactic structure from a number of parser's output. In addition, the tool has an ability to navigate the user by suggesting the order of choices. Following this order, the user can efficiently annotate sentences.In 2001, we extracted grammar rules from the EDR corpus, which is one of the existing largest Japan … More ese coypus. The drawback of the EDR corpus is that the grammar based on which the corpus is annotated is missing. Thus we first extract the grammar from the EDR corpus automatically and improve it so that the ambiguities of the grammar became as small as possible.In addition, we proposed a new framework to build semantic knowledge which plays important role not only in semantic analysis but also in syntactic analysis. It is difficult to build semantic knowledge from scratch, therefore we took an approach to combine existing semantic knowledge.In 2002, we continued to work on the two topics started in 2001. In addition to this, we constructed a management system of annotated corpora. This system allows users to retrieve various kinds of syntactic structures efficiently. The structures in a sentence are stored in a relational database system, providing users versatile retrieve capability.In order to verify the results of above research, we built a Japanese corpus consisting of about 20,000 sentences. This sentence set is an excerpt from the EDR corpus. This corpus is based on the grammar extracted from the EDR corpus and improved in this project. To annotate the corpus, the annotation tool developed in this project was used, and the resultant corpus was managed by the system mentioned above. Less