REU Site: Computational Methods for Understanding Music, Media, and Minds

REU 网站：理解音乐、媒体和思想的计算方法

• 批准号: 1950460
• 负责人: Ajay Anand
• 金额: $ 40.5万
• 依托单位: University of Rochester
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-03-01 至 2024-02-29
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1950460&HistoricalAwards=false
• 关键词: REU; Site; Computational; Methods; Understanding

How can a computer learn to read hidden text in ancient manuscripts? How can a computer be trained to transcribe music audio into music notation or compose a new song? Can a computer system teach a person to better use prosody — the musical pattern of speech – to become a more effective public speaker? These are some of the questions that students will investigate in this Research Experience for Undergraduates (REU) site at the University of Rochester. Students will explore an exciting, interdisciplinary research area that combines computer science, electrical engineering, cognitive science, and music. Each student will be mentored by two or more faculty members from the University's schools of engineering, sciences, arts, and music. Other activities of the REU site include workshops on career development; scholarship community colloquiums; graduate school preparation; Python programming for machine learning; and music-focused activities. The goals of this REU are to increase the diversity and broaden the horizons of students engaged in computer science research. The themes of music, digital media, and cognitive science will attract many students from groups under-represented in computer science. The site welcomes students from institutions where opportunities for interdisciplinary research combining computational methods, arts and humanities may be limited. Students who are already majoring in computer science will discover that the research in the field is not limited to traditional engineering applications, but can address questions of art, culture, and human psychology. Students with experience in combining computer science with humanistic research are already in great demand in industry and academia and will help define what it means to be a computer scientist in the 21st century. Students in this REU will engage in interdisciplinary research that combines machine learning, computer audition, music theory, and cognitive science. These disciplines are united by their use of a common set of formal representations and computational methods; in particular, probabilistic models and machine learning. In the research activities, REU students will work on a variety of topics. These include: creating human-computer collaborative music making systems; developing electroencephalogram (EEG) analysis methods to decode musical minds; using machine learning and multispectral imaging to read hidden text in ancient manuscripts; studying how prosody makes a person a convincing public speaker; developing big data techniques to analyze audio-visual scenes; and, exploring connections between human and computer natural language processing. The program is strengthened by the University's recently-founded audio and music engineering program, and the partnership with the Eastman School of Music. Although the major objective of the REU is to encourage students to enter STEM graduate programs, many of the projects can be expected to lead to novel and publishable research.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

计算机如何学会阅读古代手稿中的隐藏文本？如何训练计算机将音乐音频转录为音乐符号或创作新歌？计算机系统可以教一个人更好地使用韵律 - 演讲的音乐模式 - 成为更有效的公众演讲者吗？这些是学生将在罗切斯特大学的本科生（REU）网站的研究经验中调查的一些问题。学生将探索一个令人兴奋的，跨学科的研究领域，结合了计算机科学，电气工程，认知科学和音乐。每个学生将由大学工程，科学，艺术和音乐学院的两个或多个教职员工考虑。 REU网站的其他活动包括有关职业发展的研讨会；学校船社区座谈会；研究生院的准备；用于机器学习的Python编程；和以音乐为中心的活动。 REU的目标是增加多样性并拓宽参与计算机科学研究的学生的视野。音乐，数字媒体和认知科学的主题将吸引来自计算机科学不足的团体的许多学生。该网站欢迎来自机构的学生，那里的跨学科研究机会结合了计算方法，艺术和人类可能受到限制。已经专业的计算机科学专业的学生会发现，该领域的研究不仅限于传统的工程应用，而且可以解决艺术，文化和人类心理学问题。具有将计算机科学与人文研究相结合的经验的学生在工业和学术界的需求已经很大，并且将有助于定义21世纪成为计算机科学家的含义。 REU中的学生将参与跨学科研究，以结合机器学习，计算机试听，音乐理论和认知科学。这些学科通过使用一套普通的形式表示和计算方法而团结在一起。特别是概率模型和机器学习。在研究活动中，REU学生将研究各种主题。其中包括：创建人类计算机协作音乐制作系统；开发脑电图（EEG）分析方法来解码音乐思想；使用机器学习和多光谱成像读取古代手稿中的隐藏文本；研究韵律如何使人成为令人信服的公众演讲者；开发大数据技术来分析视听场景；并且，探索人类和计算机自然语言处理之间的联系。该计划由大学最近创建的音频和音乐工程计划以及与伊士曼音乐学院的合作伙伴关系加强。尽管REU的主要目的是鼓励学生进入STEM研究生课程，但可以期望许多项目导致新颖和可发布的研究。该奖项反映了NSF的法定任务，并通过使用基金会的知识分子和更广泛的影响审查标准来通过评估来表现出珍贵的支持。