Composing the Assemblage: Probing Aesthetic and Technical Dimensions of Artistic Creation with Machine Learning
Composing the Assemblage: Probing Aesthetic and Technical Dimensions of Artistic Creation with Machine Learning
复制标题
DOI：
10.1162/comj_a_00658
复制
发表时间：
2022-12-01
影响因子：
--
通讯作者：
Born，Georgina
中科院分区：
文献类型：
--
作者：
Gioti，Artemi-Maria;Einbond，Aaron;Born，Georgina
在这篇文章中，我们通过对经验的自我民族志反思，阐述了机器学习(ML)在两部新的声乐和电子音乐作品创作中的作用。我们的研究提出了一个关键问题，即ML如何塑造独特的作曲实践的美学承诺，并进而被其塑造。此外，我们还想知道，这些实践中的艺术研究如何能够从人文学科关于材料参与和关键数据研究的批评主题中获得启发。通过这些框架，我们考虑作为作曲过程的一部分，与ML算法的交互在哪些方面不同于与其他音乐技术工具的交互。我们不是关注狭隘构思的ML算法，而是考虑到发挥作用的各种组合：从作曲家、表演者和听众到扬声器、麦克风和音频描述符。我们的分析集中在对数据的解构批评上，认为数据取决于数据创建过程中涉及的决策和物质条件。它还探索了ML集合中人类和非人类合作者之间的交互如何与现有的物质参与模型有显著的相似和不同之处。追踪这些作品的创作过程，我们揭示了在创作过程中涉及到的许多非线性合作决定的美学含义。
In this article, we address the role of machine learning (ML) in the composition of two new musical works for acoustic instruments and electronics through autoethnographic reflection on the experience. Our study poses the key question of how ML shapes, and is in turn shaped by, the aesthetic commitments characterizing distinctive compositional practices. Further, we ask how artistic research in these practices can be informed by critical themes from humanities scholarship on material engagement and critical data studies. Through these frameworks, we consider in what ways the interaction with ML algorithms as part of the compositional process differs from that with other music technology tools. Rather than focus on narrowly conceived ML algorithms, we take into account the heterogeneous assemblage brought into play: from composers, performers, and listeners to loudspeakers, microphones, and audio descriptors. Our analysis focuses on a deconstructive critique of data as being contingent on the decisions and material conditions involved in the data-creation process. It also explores how interaction among the human and nonhuman collaborators in the ML assemblage has significant similarities to—as well as differences from—existing models of material engagement. Tracking the creative process of composing these works, we uncover the aesthetic implications of the many nonlinear collaborative decisions involved in composing the assemblage.