ODO: Design of Multimodal Chatbot for an Experiential Media System
ODO: Design of Multimodal Chatbot for an Experiential Media System
复制标题
DOI：
10.3390/mti4040068
复制
发表时间：
2020-09
期刊：
影响因子：
--
通讯作者：
Ravi Bhushan;Karthik Kulkarni;Vishal Kumar Pandey;Connor Rawls;Brandon Mechtley;S. Jayasuriya;Chris Ziegler
中科院分区：
文献类型：
--
作者：
Ravi Bhushan;Karthik Kulkarni;Vishal Kumar Pandey;Connor Rawls;Brandon Mechtley;S. Jayasuriya;Chris Ziegler
本文介绍了多式联运聊天机器人的设计，可在互动剧院的表演中使用。该聊天机器人的架构包括视觉和自然语言处理能力，以及在舞台上设置的非人性化移动LED阵列中的实施例。该系统设计用于与多达五个用户的互动，该系统可以执行任务，包括面部检测和情感分类，通过手机跟踪人群的运动以及实时对话，以指导用户通过非线性故事和互动游戏。最终的原型（名为ODO）是分布式多媒体系统的切实实施例，该系统解决了一些技术挑战，以通过新颖的互动为用户提供独特的体验。
This paper presents the design of a multimodal chatbot for use in an interactive theater performance. This chatbot has an architecture consisting of vision and natural language processing capabilities, as well as embodiment in a non-anthropomorphic movable LED array set in a stage. Designed for interaction with up to five users at a time, the system can perform tasks including face detection and emotion classification, tracking of crowd movement through mobile phones, and real-time conversation to guide users through a nonlinear story and interactive games. The final prototype, named ODO, is a tangible embodiment of a distributed multimedia system that solves several technical challenges to provide users with a unique experience through novel interaction.