Speech recognition and understanding using cloud resources and soft computing in RFID deployment services and online playing games

由于显示器和键盘的尺寸有限，支持语音的界面在移动设备中特别有用。尽管移动设备在人们日常生活中的应用稳步增长，语音和语言技术也取得了长足的进步，但当前的系统距离满足用户的需求还有很大的距离。在这个项目中，探索了新的研究方向，以应对这一挑战。在低层处理中，在各种语音增强方案中提出了结合传统方法和软计算方法的协作方法，以使语音识别具有应对不利条件的能力。软计算受到生物系统的启发，生物系统能够处理不确定性和不精确度，以实现健壮性、易处理性和最优解。在高级处理中，当前的研究仍然面临着让对话系统在几个对话回合内完全理解用户意图的能力的挑战。该策略包括利用分布式本体中的知识来减少混淆和歧义，并通过本体距离的新概念来提供可靠的语义可信度度量。通过利用云计算的优势，通过为移动操作系统提供版本，将低层处理和高级处理集成到现实应用中。第一个应用领域包括允许操作员与射频识别(RFID)设备和信息系统进行口头通信。免提语音系统与RFID技术相结合，有望提高监控资产和运输等众多业务操作的速度和安全性。第二个应用领域将专注于在线角色扮演游戏(RPG)，其中演员主要是通过与非游戏角色(NPC)的互动来构建的。我们的应用程序将提供与NPC进行口头交互的选项。增加这一功能将把游戏体验提升到一个新的强度水平。新的框架还将纳入语音界面，目的是加强法语和英语用户的沟通，这些用户患有各种语音障碍。

Speech-enabled interfaces are especially useful in mobile devices due to the limited display and keyboard sizes. Despite the steady growth in the adoption of mobile devices in people's daily lives, and the prodigious progress of speech and language technologies, current systems are still a great distance away from providing satisfaction to users. In this program, new research directions are investigated in order to face this challenge. At low-level processing, cooperative approaches combining conventional and soft computing methods are proposed in various speech enhancement schemes to give speech recognition the ability to cope with adverse conditions. Soft computing is inspired by biological systems that are capable of dealing with uncertainty and imprecision to achieve robustness, tractability and optimal solutions. At high-level processing, current research still faces the challenge of giving dialogue systems the ability to perfectly understand the user intents within a few dialogue turns. The strategy consists of leveraging knowledge in distributed ontologies to reduce confusability and ambiguity and to provide a reliable semantic confidence measure through a new concept of "ontological distance". Both low-level and high-level processing are integrated in realistic applications by taking advantage of cloud computing and by providing versions for mobile operating systems. The first field of applications consists of allowing human operators to communicate verbally with Radio Frequency IDentification (RFID) devices and information systems. Hands-free speech systems combined with RFID technology are expected to improve the speed and safety of numerous business operations such as monitoring assets and shipping. The second field of applications will focus on online role playing games (RPGs), where an actor is mainly constructed through interactions with non-playing characters (NPCs). Our application will provide the option of interacting verbally with NPCs. Adding this feature will upgrade the gaming experience to a new level of intensity. The new frameworks will also be integrated in speech-enabled interfaces with the aim of enhancing the communication of both French and English-speaking users suffering from various speech disorders.