Asian Language Parsing Evaluated by Hummingbird SearchServerTMat NTCIR-3
Asian Language Parsing Evaluated by Hummingbird SearchServerTMat NTCIR-3
复制标题
由 Hummingbird SearchServerTMat NTCIR-3 评估的亚洲语言解析
DOI：
--
复制
发表时间：
2002
期刊：
影响因子：
--
通讯作者：
Stephen Tomlinson
中科院分区：
文献类型：
--
作者：
Stephen Tomlinson
蜂鸟提交了第三届NII-NACSIS红外系统研讨会（ntir -3）跨语言检索任务中中文、日语和韩语单语言信息检索轨道的排序结果集。与重叠ping n-gram方法相比，SearchServer 5.3的亚洲文本切分器被发现略微提高了日语的精度分数，对中文产生了新的影响，对Ko- rean不利。SearchServer对平假名和片假名n-gram进行大小写规范化的选项大大提高了一个日语查询的精度，而对其他查询的影响则是中性的。我们发现，对n-gram解析来说，换行抑制的好处很小。汉字不化为韩文对韩国语试题集几乎没有影响。关键词：蜂鸣鸟，搜索服务器，NTCIR，中文，日语，韩语，亚洲语，解析，n-grams，切分。
Hummingbird submitted ranked result sets for the Chinese, Japanese and Korean Single Language In- formation Retrieval tracks of the Cross-Language Re- trieval Task of the 3rd NII-NACSIS Test Collection for IR Systems Workshop (NTCIR-3). SearchServer 5.3's segmenter for Asian text, compared to an overlap- ping n-gram approach, was found to modestly in- crease precision scores for Japanese, to have a neu- tral impact for Chinese, and to be detrimental for Ko- rean. SearchServer's option to case normalize Hira- gana and Katakana n-grams increased precision sub- stantially for one Japanese query and was of neutral impact for the others. Newline suppression was found to be of only minor benefit for n-gram parsing. Nor- malizing Han characters to Hangul had almost no ef- fect on the Korean test collection. Keywords: Hum- mingbird, SearchServer, NTCIR, Chinese, Japanese, Korean, Asian, parsing, n-grams, segmenting.