Microtext Processing

术语“微文本”描述了一种非常短的文本文档类型(通常是一句话或更少)，以非正式的方式书写并且未经编辑以保证质量，并且包括一些元数据。微文本在当今世界已经变得无处不在，包括在线用户评论、Facebook新闻提要和推文以及搜索查询。就其本质而言，微文本与传统的自然语言处理(NLP)是非常不同的挑战。它们的篇幅太短，阻碍了依赖词频和统计数据的自然语言处理方法，而大量的拼写错误、打字错误和非常规缩略语使标准语言资源无济于事。微文本处理应该被视为自然语言处理的一个新分支。

The term "microtext" describes a type of text document that is very short (typically one sentence or less), is written in an informal manner and unedited for quality, and includes some metadata. Microtexts have become omnipresent in today's world, and include online user comments, Facebook newsfeeds and Tweets, and search queries. By their very nature, microtexts are a very different challenge from traditional Natural Language Processing (NLP). Their short length hinders NLP methodologies that rely on word frequencies and statistics, and the abundance of spelling mistakes, typos, and unconventional abbreviations make standard linguistic resources unhelpful. Microtext processing should be seen as a new branch of NLP.