Talkback: Voice Control of Software for the Creative Industries

我们将把联合收割机尖端的人工智能和自然语言处理与音乐制作中数字控制的行业标准方法结合起来，即乐器数字接口。40年来，MIDI一直是数字音乐硬件/软件之间传递指令的标准计算机“语言”，例如“Play Note Middle C”。它还可以发送命令到数据采集器，添加一个轨道或更改控制的值。由于所有Daws都与MIDI通信，因此Talkback可以使用用户最熟悉的任何Daws来实现。因此，通过Talkback，视障用户可以在弹吉他时只需要求软件“使用我最喜欢的设置创建吉他曲目，然后开始录制，现在。“此外，由于Talkback的广泛采用和简单性，使用Talkback意味着类似的非音乐应用程序可能获得同样的语音控制机会，如电影编辑和图形软件。Talkback是一个项目，通过为数百万专业和教育用户使用的专业数字音乐软件提供语音命令功能，改善创意产业的可访问性和工作流程。”它还解决了这个软件的重要可访问性问题，目前只依赖于基于屏幕的交互以及操作键盘和鼠标的视觉和移动性要求。音乐制作采用专门的数字音频工作站（Digital Audio Workstation）软件，该软件将音乐合成/生成和音频录制/混合集成到一个基于屏幕的系统中。一个项目包括乐器或声音的单独“轨道”，现代技术需要20个以上，有时多达200个轨道。每个音轨可能是一个麦克风录音或软件中生成的数字乐器，但每个音轨都有许多不同的控件，因此在整个项目中必须正确设置数千个单独的参数。Daws使用下拉菜单和图形控件，这些控件高度依赖于视觉效果，因此如果看不到屏幕，它们几乎不可能使用。即使是市售的物理控制表面也需要出色的物理移动性和精细的运动控制，因此对具有视觉和/或移动障碍的人的支持非常有限。即使是非残疾用户也无法在演奏乐器时操作这些系统，因为这样做会妨碍使用鼠标。Talkback将音乐创作的行为回归到人类交流的起源，将语音控制放回自然说出请求的领域。当在乐队演奏时，我们只是说“吉他应该更响亮”：吉他控制应该以同样的方式操作。

We will combine cutting edge Artificial Intelligence and Natural Language Processing with the industry standard method of digital control in music production, MIDI (Musical Instrument Digital Interface). For 40 years, MIDI has been the standard computer 'language' for passing instructions between digital music hardware/software such as "Play Note Middle C". It can also send commands to DAWs, to add a track or change the values of controls. Since all DAWs communicate with MIDI, Talkback can be implemented with whichever DAW a user is most familiar.Thus, with Talkback, a visually impaired user could be playing their guitar and simply ask the software to "Create a Guitar track with my favourite settings, and start recording, now."In addition, because of its widespread adoption and simplicity, using MIDI means that similar non-musical applications could potentially access the same opportunities for voice control, like film editing and graphics software.Talkback is a project to improve accessibility and workflow in the creative industries by providing voice command functionality to the specialised digital music software millions of professional and educational users employ. It also addresses important accessibility concerns with this software which at present relies exclusively on screen-based interaction and the attendant visual and mobility requirements of operating keyboard and mouse.Music production employs specialised Digital Audio Workstation (DAW) software which combines music composition/generation and audio recording/mixing into one screen-based system. A project comprises separate 'tracks' for instruments or sounds, with modern techniques requiring upwards of 20 and sometimes as many as 200 tracks. Each track may be a microphone recording or a digital instrument generated within the software, but each have many different controls, thus many thousands of separate parameters must be correctly set within the entire project.DAWs use drop-down menus and graphical controls which are highly visually reliant so without seeing the screen they are virtually impossible to use. Even commercially available physical control surfaces require excellent physical mobility and fine motor control so support for people with visual and/or mobility impairments is highly limited. Even non-disabled users cannot operate these systems while playing their instrument since doing so precludes using the mouse.Talkback returns the act of musical creation to its origins in human communication, by placing DAW controls back into the domain of naturally spoken requests. When playing in a band we simply say "the guitars should be louder": DAW control should operate the same way.