Balanced corpus of contemporary written Japanese
Balanced corpus of contemporary written Japanese
复制标题
DOI：
10.1007/s10579-013-9261-0
复制
发表时间：
2014-06-01
影响因子：
2.7
通讯作者：
Den, Yasuharu
中科院分区：
文献类型：
--
作者：
Maekawa, Kikuo;Yamazaki, Makoto;Den, Yasuharu
现代书面语平衡语料库（BCCWJ）是日本第一个1亿字的平衡语料库。它由三个子语料库（出版物子语料库、图书馆子语料库和专用子语料库）组成，涵盖了广泛的文本注册，包括一般书籍、杂志、报纸、政府白色报纸、畅销书、互联网公告板、博客、学校教科书、国民饮食会议记录、地方政府的宣传通讯、法律和诗歌。尽可能使用随机抽样技术，以最大限度地提高语料库的代表性。语料库的注释方面的双重POS分析，文件结构，和书目信息。BCCWJ目前有三种不同的访问方式，包括Chunagon，一个基于网络的双POS分析数据界面。最后，一些试点评估的语料库方面的文本多样性的结果报告。分析内容包括词性分布、词类分布、正字法熵、句长、形容词谓语的变异等。在所有这些分析中都观察到高度的文本多样性。
The balanced corpus of contemporary written Japanese (BCCWJ) is Japan's first 100 million words balanced corpus. It consists of three subcorpora (publication subcorpus, library subcorpus, and special-purpose subcorpus) and covers a wide range of text registers including books in general, magazines, newspapers, governmental white papers, best-selling books, an internet bulletin-board, a blog, school textbooks, minutes of the national diet, publicity newsletters of local governments, laws, and poetry verses. A random sampling technique is utilized whenever possible in order to maximize the representativeness of the corpus. The corpus is annotated in terms of dual POS analysis, document structure, and bibliographical information. The BCCWJ is currently accessible in three different ways including Chunagon a web-based interface to the dual POS analysis data. Lastly, results of some pilot evaluation of the corpus with respect to the textual diversity are reported. The analyses include POS distribution, word-class distribution, entropy of orthography, sentence length, and variation of the adjective predicate. High textual diversity is observed in all these analyses.