Chinese Named Entity Identification Using Class-based Language Model
Chinese Named Entity Identification Using Class-based Language Model
复制标题
DOI:
10.3115/1072228.1072240
复制
发表时间:
2002-08
期刊:
影响因子:
--
通讯作者:
Jian Sun-;Jianfeng Gao;Lei Zhang;M. Zhou;C. Huang
中科院分区:
文献类型:
--
作者:
Jian Sun-;Jianfeng Gao;Lei Zhang;M. Zhou;C. Huang
We consider here the problem of Chinese named entity (NE) identification using statistical language model(LM). In this research, word segmentation and NE identification have been integrated into a unified framework that consists of several class-based language models. We also adopt a hierarchical structure for one of the LMs so that the nested entities in organization names can be identified. The evaluation on a large test set shows consistent improvements. Our experiments further demonstrate the improvement after seamlessly integrating with linguistic heuristic information, cache-based model and NE abbreviation identification.