REU Site: Computational Methods for Understanding Music, Media, and Minds

电脑怎么能学会读古代乐谱呢？信号处理和自然语言分析的方法能告诉我们流行音乐的历史吗？计算机系统能否教会一个人更好地使用韵律（演讲的音乐模式），从而成为一个更有效的公众演说家？这些是学生们将在罗切斯特大学本科生研究经历（REU）网站上调查的一些问题。学生将探索一个令人兴奋的跨学科研究领域，它结合了计算机科学、电子工程、认知科学和音乐。每个学生将由来自大学工程学院和音乐学院的两名或两名以上的教师指导。资源评价处的其他活动包括职业发展讲习班；学术社区讨论会；机器学习的Python编程；以及以音乐为中心的活动。该REU的目标是增加从事计算机科学研究的学生的多样性和拓宽视野。音乐、数字媒体和认知科学的主题将吸引许多来自计算机科学中代表性不足的群体的学生。已经主修计算机科学的学生会发现，该领域的研究不仅限于传统的工程应用，还可以解决艺术、文化和人类心理的问题。具有计算机科学与人文研究相结合经验的学生在工业界和学术界已经非常受欢迎，他们将有助于定义21世纪的计算机科学家意味着什么。该大学REU的学生将从事结合机器学习、音频工程、音乐理论和认知科学的跨学科研究。这些学科通过使用一套共同的形式表示和计算方法而统一起来；特别是概率模型和机器学习。在研究活动中，REU的学生将研究诸如使用机器学习和广谱成像来恢复丢失的古代乐谱等主题；与认知科学家合作，了解韵律如何使一个人成为令人信服的演说家；并开发算法来同步一个事件的数百个音频和视频流，以重建现场音乐表演的体验。罗彻斯特大学的计算机科学系在机器学习、自然语言处理和计算机视觉方面有着悠久的贡献历史，其大脑与认知科学系在全国排名前三。伊士曼大学最近成立的音频工程专业发展迅速，伊士曼音乐学院是美国首屈一指的音乐学院。虽然REU的主要目标是鼓励学生进入STEM研究生课程，但许多项目有望在机器学习和音频处理方面产生新颖且可发表的研究成果。

How can a computer learn to read an ancient musical score? What can methods from signal processing and natural language analysis tell us about the history of popular music? Can a computer system teach a person to better use prosody (the musical pattern of speech) in order to become a more effective public speaker? These are some of the questions that students will investigate in the University of Rochester's Research Experience for Undergraduates (REU) site. Students will explore an exciting, interdisciplinary research area that combines computer science, electrical engineering, cognitive science, and music. Each student will be mentored by two or more faculty members from the University's schools of engineering and music. Other activities of the REU site include workshops on career development; scholarship community colloquiums; Python programming for machine learning; and music-focused activities. The goals of this REU are to increase the diversity and broaden the horizons of students engaged in computer science research. The themes of music, digital media, and cognitive science will attract many students from groups under-represented in computer science. Students who are already majoring in computer science will discover that the research in the field is not limited to traditional engineering applications, but can address questions of art, culture, and human psychology. Students with experience in combining computer science with humanistic research are already in great demand in industry and academia, and will help define what it means to be a computer scientist in the 21st century.Students in the University's REU will engage in interdisciplinary research that combines machine learning, audio engineering, music theory, and cognitive science. These disciplines are united by their use of a common set of formal representations and computational methods; in particular, probabilistic models and machine learning. In the research activity, REU students will work on topics such as using machine learning and wide-spectrum imaging to recover lost ancient musical scores; working with cognitive scientists to understand how prosody makes a person a convincing public speaker; and developing algorithms for synchronizing hundreds of audio and video streams of an event to reconstruct the experience of live music performances. The University of Rochester's Department of Computer Science has a long history of contributions in machine learning, natural language processing, and computer vision, and the Department of Brain and Cognitive Science is in the top three nationally. The University's recently-founded audio engineering program is growing rapidly, and the Eastman School of Music is the nation's premiere music conservatory. Although the major objective of the REU is to encourage students to enter STEM graduate programs, many of the projects can be expected to lead to novel and publishable research in machine learning and audio processing.