EAPSI: Generating Word Embeddings using Extreme Learning Machines for Classifying Clinical Texts

1950年，计算机科学家艾伦·图灵提出了一种测试真正的人工智能的方法。在图灵看来，如果一台计算机能够理解人类语言，它就必须被认为是智能的。经过60多年的研究，这仍然是一项持续的努力。最近的方法，包括使用高级统计学的神经语言模型，在实现图灵的愿景方面取得了长足的进步。本研究在已有研究的基础上，探索提高基于计算机的自然语言理解的方法。这项研究将在南洋理工大学著名机器学习专家黄光斌教授的指导下进行。自然语言处理(NLP)涉及开发基于计算机的算法来理解自然语言。统计语言模型通常用于各种自然语言处理任务，包括机器翻译和文本分类。基于神经网络的语言模型，也称为神经嵌入，将单词(或短语)映射到低维空间中的数字表示。通常，神经网络使用反向传播来训练神经网络，这会导致训练速度较慢。极限学习机(ELM)是一种神经网络，其隐含神经元是随机生成的隐含节点。这项研究涉及使用榆树来更快地训练神经植入的生成。东亚和太平洋暑期学院计划下的这个奖项支持一名美国研究生的暑期研究，由NSF和新加坡国家研究基金会联合资助。

In 1950, the computer scientist Alan Turing proposed a test for true artificial intelligence. In Turing's view, a computer must be considered intelligent if it could understand human language. After more than 60 years of research, this is still an ongoing effort. Recent methods, including neural language models that use advanced statistics, have made great strides towards realizing Turing's vision. This study builds on existing research to explore methods for improving computer-based natural language understanding. The research will be conducted under the mentorship of Professor Guang-bin Huang, a noted expert on machine learning, of Nanyang Technological University.Natural language processing (NLP) involves the development of computer-based algorithms to understand natural language. Statistical language models are typically used for various NLP tasks, including machine translation and text categorization. Language models based on neural networks, also known as neural embeddings, map words (or phrases) to a numerical representation in a low-dimensional space. Typically, neural networks use back-propagation for training a neural network, which results in slow training. Extreme Learning Machines (ELM) is a type of neural network, where hidden neurons are randomly generated hidden nodes. This study involves the use of ELM for faster training in the generation of neural embeddings.This award under the East Asia and Pacific Summer Institutes program supports summer research by a U.S. graduate student and is jointly funded by NSF and the National Research Foundation of Singapore.