REU Site: Recent Advances in Natural Language Processing

REU 网站：自然语言处理的最新进展

• 批准号: 2349452
• 负责人: Jugal Kalita
• 金额: $ 46.5万
• 依托单位: University of Colorado at Colorado Springs
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2024
• 资助国家: 美国
• 起止时间: 2024-02-01 至 2027-01-31
• 项目状态: 未结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2349452&HistoricalAwards=false
• 关键词: REU; Site; Recent; Advances; Natural

The objective of this project is to expose motivated undergraduates who aspire to pursue advanced careers in Computer Science, in particular in Artificial Intelligence and Machine Learning (AI-ML), to active research experience early in their careers. This project will develop a summer Research Experience for Undergraduates (REU) site at the University of Colorado, Colorado Springs, to engage ten participants per year from around the country in cutting-edge research on topics such as the use and security of Large Language Models, and the use of the new paradigm of Quantum Computing to better solve problems in Natural Language Processing. The students will write software to solve interesting and timely problems, write papers for publication, and will be exposed to procedures for applying for graduate school. The proposal will also focus on training future computer scientists from institutions with limited research opportunities, women, and under-represented minorities. The research experience will encourage these students to be productive researchers in academic and non-academic environments during their future careers.The participating students will be introduced to the latest advances such as Deep Learning, Large Language Models, and Quantum Computing via focused lectures, discussion of latest publications, and personalized readings. In particular, the students will learn about latest innovations in Deep Learning, including Transformer-inspired architectures, such as the Bidirectional Encoder Representations from Transformers (BERT) and the Generative Pre-Trained Transformers (GPT) series, that have ushered in a recent period of sustained improved results to many problems that have been the focus of research for years. The students will perform hands-on research on novel problems, conduct experiments using Transformer-based Deep Learning architectures and Quantum Computing methods, and communicate their results through written papers and presentations. Example projects will involve controlling generation of large language models; defending language models against attacks; and the use of Quantum Computing in solving tasks such as part-of-speech tagging and named entity recognition.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目的目标是让那些渴望在计算机科学，特别是人工智能和机器学习（AI-ML）领域追求高级职业的积极的本科生，在他们的职业生涯早期获得积极的研究经验。该项目将在科罗拉多大学科罗拉多斯普林斯分校为本科生开发一个夏季研究体验（REU）站点，每年吸引来自全国各地的10名参与者进行前沿研究，主题包括大型语言模型的使用和安全性，以及使用量子计算的新范式来更好地解决自然语言处理中的问题。学生将编写软件来解决有趣和及时的问题，撰写论文发表，并将接触到申请研究生院的程序。该提案还将侧重于培训来自研究机会有限的机构、女性和未被充分代表的少数族裔的未来计算机科学家。研究经历将鼓励这些学生在未来的职业生涯中成为学术和非学术环境中富有成效的研究人员。参与的学生将通过重点讲座、最新出版物讨论和个性化阅读，了解深度学习、大型语言模型和量子计算等最新进展。特别是，学生们将学习深度学习的最新创新，包括变形金刚启发的架构，如变形金刚的双向编码器表示（BERT）和生成预训练变形金刚（GPT）系列，它们在最近一段时间内引领了持续改进的结果，解决了多年来一直是研究重点的许多问题。学生们将对新问题进行动手研究，使用基于transformer的深度学习架构和量子计算方法进行实验，并通过书面论文和演示文稿交流他们的结果。示例项目将涉及控制大型语言模型的生成；保护语言模型免受攻击；以及使用量子计算来解决词性标注和命名实体识别等任务。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。