Collaborative Research: Opening a Quantitative Window into the Mind and Communication of Dolphins

这种脑容量大、群居性强的宽吻海豚的认知和沟通能力堪称传奇，引起了科学家和广大公众的兴趣和想象。值得注意的是，海豚是为数不多的声音学习者之一；因此，海豚为我们提供了一个独特的、与鸣禽不同的模型，以促进我们对一种具有高度社会和行为复杂性的大脑量哺乳动物的发声学习和交流过程的理解。尽管对海豚声音交流进行了数十年的研究，但海豚之间声音交流的组成要素、要素的顺序和时间组织以及声音交流的本质仍然是一个谜。为了破译海豚的交流并进一步阐明这些问题，pi将在野外和水族馆中使用观察方法以及在水族馆中使用两种实验方法。第一种方法是研究海豚在面对新奇事物时如何协调它们的行为：当海豚被要求同时呈现新奇的行为时，它们是如何协调它们的行为的？当面对新的挑战时，他们如何成功地作为一个团队工作？在第二种方法中，研究人员将为海豚提供双向、交互式触摸屏和音频系统。通过给予他们对互动系统的选择和控制，以及观察和记录他们如何使用和应对互动的偶然性，他们将获得与物体、互动或活动暂时配对的新声音信号，从而探索他们对声音学习和其他认知过程的倾向。由于与海豚有关的活动将在一个主要水族馆的露天露天环境中进行，因此水族馆研究特别有利于推广工作和非正式的科学教育。这次展览已经从海豚表演变成了关于动物护理、行为和保护的更具教育性的展示。研究活动将与公众参观和学童实地考察同时进行，因此，研究工作将实时与公众沟通。实际上，只要付出适度的努力和成本，所有提出的活动都可以在巴尔的摩的国家水族馆举行公开展览，指导来访的学童了解研究过程和跨科学界限的合作研究。对研究地点的实地考察是与亨特学院本科生和研究生实地研究课程共同组织的，是向这些学生展示和参与实际前沿研究的绝佳机会。这是由动物认知心理学家、海洋哺乳动物科学家、物理学家、计算神经科学家和生物声学家等实验室紧密结合的跨学科合作项目，旨在将高通量设置扩展到圈养海豚的交流研究中。该提案的一个关键智力优点是通过从统计力学、机器学习和信号处理中提取的强大方法来解决动物认知和交流领域的这些基本问题。“解码”海豚交流的核心技术问题是声音定位和将检测到的发声归因于特定海豚个体的困难，缺乏自动行为分析方法，以及创建归因于声音和行为交易或“对话”的综合图片的关键步骤，这些交易或“对话”可以进行高穿透分析。另一个技术问题是设计和部署先进的双向交互系统，该系统由水下触摸板和实时音频输入/输出以及相关的交互界面组成。最后，本项目还解决了用于实地研究的空中和水上无人机部署中的重要技术问题。

The cognitive and communication prowess of the large-brained, highly gregarious bottlenose dolphin is legendary and has captured the interest and imagination of scientists and the public at large. Notably, dolphins are one of a handful of species that are vocal learners; thus the dolphin presents us with a unique and alternative model to songbirds to advance our understanding of the processes that underlie vocal learning and communication in a large-brained mammal showing high social and behavioral complexity. Despite decades of research on dolphin vocal communication, the constituent elements, the sequential and temporal organization of the elements, and the nature of vocal transactions between dolphins remain enigmatic. In order to decipher dolphin communication and further elucidate these issues, the PIs will use observational approaches in the wild and in an aquarium as well as two experimental approaches in an aquarium. A first approach studies how dolphins coordinate their behavior in the face of novelty: How do dolphins synchronize their behavior when requested to present novel behaviors in tandem? How do they succeed in working as a team when confronted with a new challenge? In a second approach, the researchers will provide dolphins with a two-way, interactive touchscreen and audio system. Their proclivity for vocal learning and their other cognitive processes will be probed by giving them choice and control over the interactive system and observing and documenting how they use and respond to the contingencies of their interactions, which shall be obtaining novel acoustic signals temporally paired with objects, interactions or activities. The aquarium studies are particularly conducive to outreach efforts and informal science education since the dolphin-related activities will be conducted in an open amphitheater environment at a leading aquarium. The exhibit has changed from dolphin shows to more educational demonstrations about animal care, behavior, and conservation. The research activities will take place concurrently with visits of the public and field trips of school children and therefore, the research endeavor will be communicated to the public in real time. Virtually all the activities proposed can, with modest effort and cost, be made into an open exhibit at the National Aquarium in Baltimore, instructing visiting schoolchildren on the research process and on collaborative research across scientific boundaries. The field trips to the research sites are organized jointly with undergraduate and graduate courses in field research for Hunter College students and are excellent opportunities to showcase and engage actual cutting edge research to these students. This tightly-knit interdisciplinary collaboration between the labs of animal cognitive psychologist and marine mammal scientist and physicist, computational neuroscientist and bio-acoustician, seeks to and extend high-throughput settings to dolphin communication studies in captivity.A key intellectual merit of this proposal is to address these fundamental questions in the field of animal cognition and communication through powerful methods drawn from statistical mechanics, machine learning, and signal processing. Central technical problems in "decoding" dolphin communication are the difficulty in sound localization and attributing the detected vocalizations to specific individual dolphins, the lack of automated behavioral analysis methods, and the crucial step of creating an integrated picture of attributed vocal and behavioral transactions or "conversations" that can be subjected to high-through analysis. Another technical problem is the design and deployment of an advanced two-way interactive system consisting of an underwater touchpad and real-time audio input/output, plus the associated set of interaction interfaces. Finally, this project also addresses important technical problems in the deployment of aerial and aquatic drones for field studies.