«Máquina de Ouver» - From Sound to Type: Finding the Visual Representation of Speech by Mapping Sound Features to Typographic Variables
«Máquina de Ouver» - From Sound to Type: Finding the Visual Representation of Speech by Mapping Sound Features to Typographic Variables
复制标题
«Máquina de Ouver» - 从声音到类型：通过将声音特征映射到印刷变量来查找语音的视觉表示
DOI：
10.1145/3359852.3359892
复制
发表时间：
2019
期刊：
影响因子：
--
通讯作者：
Penousal Machado
中科院分区：
文献类型：
--
作者：
João Couceiro e Castro;Pedro Martins;A. Boavida;Penousal Machado
许多作者认为印刷术是语言的视觉表示，通过书写，人类找到了一种注册和共享信息的方法。纵观印刷术的历史，有许多作者探索了单词和它们的声音之间的联系，试图缩小我们所说的、我们听到的和应该如何阅读之间的差距。我们介绍“Máquina de Ouver”，这是一个分析语音录音并使用印刷变量和构图创建其表现力的视觉表示的系统。我们的系统利用 Praat、Adobe 的 InDesign 和 Adobe 的 After Effects 软件的脚本功能来检索语音录音中的声音特征，并动态创建排版构图，从而生成海报等静态工件或视频等动态工件。我们的大部分实验过程都使用诗歌表演作为系统输入，因为就表现力而言，这可能是最具活力和最丰富的言语形式之一。
Typography is considered by many authors the visual representation of language, and through writing, the human being found a way to register and share information. Throughout the history of typography, there were many authors that explored this connection between words and their sounds, trying to narrow the gap between what we say, how we hear it and how it should be read. We introduce "Máquina de Ouver", a system that analyses speech recordings and creates a visual representation for its expressiveness, using typographic variables and composition. Our system takes advantage of the scripting capabilities of Praat, Adobe's InDesign and Adobe's After Effects software to retrieve the sound features from speech recordings and dynamically creates a typographic composition that results in a static artifact as a poster or a dynamic one, such as a video. The majority of our experimentation process uses poetry performances as the system input, since this can be one of the most dynamic and richest forms of speech in terms of expressiveness.