Nanoblog processing

自然语言处理（NLP）传统上是用长文档来完成的，使用这些文档的任务可以实现非常高的性能，许多甚至被认为是“解决”的。短信的普及和社交网络的创建导致了短信或“微博”的普及，许多以前解决的NLP任务再次成为公开的挑战。新的困难来自信息的长度短，可用的上下文信息有限，使用非常规语言，以及对话的社会联系和动态性质。然而，经过十年的研究工作，这些挑战中的许多已经被克服，微博处理系统通常可以实现与传统NLP相当的性能。由于这些进步，微博也成为其他研究领域的宝贵资源。NLP的下一个前沿将来自在线游戏和游戏社区中越来越流行的游戏聊天消息。这些消息放大了微博的问题：它们甚至更短，有时只包含一个单词或首字母缩写，完全没有信息上下文，它们使用的语言是为它们所链接的特定游戏量身定制的，在游戏之外就是胡言乱语，只有在游戏期间才有意义。由于其极短的性质，我们称这些对话为“纳米博客”。 这项研究提案的长期目标是开拓纳米博客NLP领域，并确保加拿大在这一新兴研究领域的领导地位。为了实现这一目标，我们确定了三个短期研究目标，在未来五年内完成。目标1：我们将设计，构建和标记一个真实世界的纳米博客语料库。目标2：我们将创建纳米博客上下文建模，规范化和语言检测算法。目标3：我们将创建纳米博客网络欺凌过滤算法。

Natural Language Processing (NLP) has traditionally been done with long documents, and tasks with such documents achieve very high performances and many are even considered "solved". The popularity of SMS messaging and the creation of social networks led to the popularization of short text messages or "microblogs", and many previously-solved NLP tasks became open challenges again. New difficulties stemmed from the short length of the messages, the limited contextual information available, the use of unconventional language, and the socially-linked and dynamic nature of the conversations. Nevertheless, after a decade of research work, many of these challenges have been overcome and microblog-processing systems routinely achieve performances comparable to those in traditional NLP. And thanks to these advances, microblogs have become a valuable resource in other research areas as well. The next frontier in NLP will come from increasingly-popular in-game chat messages found in online games and gaming communities. These messages amplify the problems of microblogs: they are even shorter, consisting of sometimes only a single word or acronym and completely devoid of in-message context, they use language tailored to the specific game they are linked to and that is gibberish outside of that game, and only make sense as live conversations during a game. Due to their extremely short nature, we call these conversations "nanoblogs". The long-term objective of this research proposal is to pioneer the area of nanoblog NLP and ensure Canada's leadership in this emerging research area. To achieve this, we have defined three short-term research objectives to accomplish over the next five years. Objective 1: We will design, construct, and label a real-world nanoblog corpus. Objective 2: We will create nanoblog context modelling, normalization, and language detection algorithms. Objective 3: We will create nanoblog cyber-bullying filter algorithms.