Research of speech and singing voice synthesis by MIDI accordion

本研究以MIDI手风琴为界面，通过实时“表演”开发人工语音语音系统，以该系统为前提创作新“歌”，并对该“歌”中产生的“无主声音”进行综合的哲学考察。作为这项研究的结果，我们提出了“Brother’s Button-to-Phoneme Transfer Standard for International languages （BBPTSI）”，这是一种对应于多种语言的音素控制标准，并且能够创作基于该标准的音乐作品“Yume no Waltz”。此外，使用“和弦Avarave算法”，这是为微音高控制而开发的，我们开发了一种方法，通过约束编程技术从可选的旋律线（连续音高变化）转移到钢琴键盘的乐谱。

This research is for the development of an artificial voice speech system via a real-time "performance" that utilizes a MIDI accordion as an interface, the composition of a new "song" with that system as a prerequisite, and synthetically conducts a philosophical examination of the "ownerless voice" generated in that "song". As a result of that research, we presented the "Brother's Button-to-Phoneme Transfer Standard for International languages (BBPTSI)", a standard for phoneme control that corresponds to multiple languages, and was able to compose "Yume no Waltz", a musical composition that is based on that standard. In addition, using the "Chord Avarave Algorithm", which was developed for microtonal pitch control, we developed a method to transfer from an optional melody line (continuous pitch change) to a musical score for a piano keyboard via a constraint programming technique.