CAREER: Modeling and Optimizing User-Centric Mixed-Initiative Spoken Dialog Systems

职业:建模和优化以用户为中心的混合主动语音对话系统

基本信息

  • 批准号:
    0238514
  • 负责人:
  • 金额:
    $ 50万
  • 依托单位:
  • 依托单位国家:
    美国
  • 项目类别:
    Continuing Grant
  • 财政年份:
    2003
  • 资助国家:
    美国
  • 起止时间:
    2003-03-01 至 2010-02-28
  • 项目状态:
    已结题

项目摘要

Conversational interfaces hold the promise of providing natural, easy, and universal access to information. This project targets two specific problems in conversational engineering under a unifying stochastic modeling framework: (1) dialog interaction modeling (2) user modeling in spoken dialog. These problems are related: user models are essential in designing optimal dialog strategies, while discourse state information is essential for user behavior modeling. Conversational participants -- humans or machines -- are modeled as stochastic dynamical systems, interacting with one another over a noisy communication channel. Noise in the channel may be due to errors in machine speech recognition, language understanding, or other machine/user communication errors. Algorithms based on mathematical game theory and robust design are formulated for derivation of optimal mixed-initiative dialog control strategies. The approach to modeling user behavior is data-driven with an emphasis on behavior under error conditions and on the inclusion of automatic emotion tracking. Again, a unified statistical framework provides a way for integrating multiple sources of information (e.g., acoustic, lexical, nonverbal and discourse) based on information-theoretic principles. The research development will be based on annotated spoken language corpora from real human-machine dialogs from a variety of real application domains including air travel and call center applications and an immersive training system for military/security applications being developed at the University of Southern California (USC).The educational component creates a new curriculum in spoken language processing: a two-semester graduate sequence, developed for simultaneous offering both on campus and on USC ``Distance Education Network" will target basic speech processing through the latest advances in speech recognition, speech synthesis, and spoken dialog. The courses are relevant to a wide range of programs, in addition to core electrical engineering, including computational linguistics, intelligent systems in computer science, integrated media and creative technologies, phonetics, and psychology. In addition, a unique interdisciplinary undergraduate course with a theme on human versus machine processing of spoken language will be developed and implemented. The research and education components are tightly integrated, with courses featuring the latest research results through demonstrations and hands-on projects, with an emphasis on `learning by doing'. Likewise, research serves as an effective vehicle for education in terms of enabling the training of both undergraduate and doctoral students. This project in spoken language engineering is unique in terms of its scope and societal relevance, spanning both fundamental and applied aspects of spoken language research, including an industry perspective, and creating synergies with other activities within the university in multimedia, natural language processing, and agent technology. It will serve as a vehicle to promote cross-disciplinary graduate and undergraduate research and education.
对话式界面有望提供自然、简单和通用的信息访问。 本研究在一个统一的随机建模框架下,针对会话工程中的两个具体问题:(1)对话交互建模(2)口语对话中的用户建模。这些问题是相互关联的:用户模型是设计最佳对话策略的基础,而会话状态信息是用户行为建模的基础。会话参与者-人类或机器-被建模为随机动态系统,通过嘈杂的通信信道相互交互。信道中的噪声可能是由于机器语音识别、语言理解中的错误或其他机器/用户通信错误。基于数学博弈论和鲁棒设计的算法推导出最优的混合主动对话控制策略。建模用户行为的方法是数据驱动的,重点是错误条件下的行为和自动情感跟踪。同样,统一的统计框架提供了一种整合多种信息来源的方法(例如,声学、词汇、非语言和话语)。研究开发将基于来自各种真实的应用领域的真实的人机对话的注释口语语料库,包括航空旅行和呼叫中心应用以及南加州大学(USC)正在开发的军事/安全应用的沉浸式培训系统。一个两学期的研究生课程,同时在校园和南加州大学"远程教育网络”上提供,将通过语音识别、语音合成和口语对话的最新进展,以基本语音处理为目标。这些课程与广泛的课程有关,除了核心电气工程,包括计算语言学,计算机科学智能系统,综合媒体和创意技术,语音学和心理学。 此外,一个独特的跨学科的本科课程,以人类与机器处理口语为主题将开发和实施。研究和教育部分紧密结合,课程通过演示和实践项目介绍最新研究成果,强调“边做边学”。 同样,研究是教育的有效工具,可以培养本科生和博士生。这个口语工程项目在其范围和社会相关性方面是独一无二的,涵盖口语研究的基础和应用方面,包括行业视角,并与大学内多媒体、自然语言处理和其他活动产生协同效应代理技术。它将作为促进跨学科研究生和本科生研究和教育的工具。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Shrikanth Narayanan其他文献

Clinical note section classification on doctor-patient conversations in low-resourced settings
资源匮乏地区医患对话的临床记录部分分类
Seeing speech: Capturing vocal tract shaping using real-time magnetic resonance imaging [Exploratory
看到语音:使用实时磁共振成像捕捉声道形状 [探索性
  • DOI:
  • 发表时间:
    2008
  • 期刊:
  • 影响因子:
    0
  • 作者:
    E. Bresch;Yoon;Krishna Nayak;Dani Byrd;Shrikanth Narayanan
  • 通讯作者:
    Shrikanth Narayanan
Latent acoustic topic models for unstructured audio classification
用于非结构化音频分类的潜在声学主题模型
Proceedings of the 8th Annual Conference on the Science of Dissemination and Implementation
  • DOI:
    10.1186/s13012-016-0452-0
  • 发表时间:
    2016-08-01
  • 期刊:
  • 影响因子:
    13.400
  • 作者:
    David Chambers;Lisa Simpson;Felicia Hill-Briggs;Gila Neta;Cynthia Vinson;David Chambers;Rinad Beidas;Steven Marcus;Gregory Aarons;Kimberly Hoagwood;Sonja Schoenwald;Arthur Evans;Matthew Hurford;Ronnie Rubin;Trevor Hadley;Frances Barg;Lucia Walsh;Danielle Adams;David Mandell;Lindsey Martin;Joseph Mignogna;Juliette Mott;Natalie Hundt;Michael Kauth;Mark Kunik;Aanand Naik;Jeffrey Cully;Alan McGuire;Dominique White;Tom Bartholomew;John McGrew;Lauren Luther;Angie Rollins;Michelle Salyers;Brittany Cooper;Angie Funaiole;Julie Richards;Amy Lee;Gwen Lapham;Ryan Caldeiro;Paula Lozano;Tory Gildred;Carol Achtmeyer;Evette Ludman;Megan Addis;Larry Marx;Katharine Bradley;Tonya VanDeinse;Amy Blank Wilson;Burgin Stacey;Byron Powell;Alicia Bunger;Gary Cuddeback;Miya Barnett;Nicole Stadnick;Lauren Brookman-Frazee;Anna Lau;Shannon Dorsey;Michael Pullmann;Shannon Mitchell;Robert Schwartz;Arethusa Kirk;Kristi Dusek;Marla Oros;Colleen Hosler;Jan Gryczynski;Carolina Barbosa;Laura Dunlap;David Lounsbury;Kevin O’Grady;Barry Brown;Laura Damschroder;Thomas Waltz;Byron Powell;Mona Ritchie;Thomas Waltz;David Atkins;Zac E. Imel;Bo Xiao;Doğan Can;Panayiotis Georgiou;Shrikanth Narayanan;Cady Berkel;Carlos Gallo;Irwin Sandler;C. Hendricks Brown;Sharlene Wolchik;Anne Marie Mauricio;Carlos Gallo;C. Hendricks Brown;Sanjay Mehrotra;Dharmendra Chandurkar;Siddhartha Bora;Arup Das;Anand Tripathi;Niranjan Saggurti;Anita Raj;Eric Hughes;Brian Jacobs;Eric Kirkendall;Danielle Loeb;Katy Trinkley;Michael Yang;Andrew Sprowell;Donald Nease;Aaron Lyon;Cara Lewis;Meredith Boyd;Abigail Melvin;Semret Nicodimos;Freda Liu;Nathanial Jungbluth;Aaron Lyon;Cara Lewis;Meredith Boyd;Abigail Melvin;Semret Nicodimos;Freda Liu;Nathanial Jungbluth;Allen Flynn;Zach Landis-Lewis;Anne Sales;Jure Baloh;Marcia Ward;Xi Zhu;Ian Bennett;Jurgen Unutzer;Johnny Mao;Enola Proctor;Mindy Vredevoogd;Ya-Fen Chan;Nathaniel Williams;Phillip Green;Steven Bernstein;June-Marie Rosner;Michelle DeWitt;Jeanette Tetrault;James Dziura;Allen Hsiao;Scott Sussman;Patrick O’Connor;Benjamin Toll;Michael Jones;Julie Gassaway;Jonathan Tobin;Douglas Zatzick;Angela R. Bradbury;Linda Patrick-Miller;Brian Egleston;Olufunmilayo I. Olopade;Michael J. Hall;Mary B. Daly;Linda Fleisher;Generosa Grana;Pamela Ganschow;Dominique Fetzer;Amanda Brandt;Dana Farengo-Clark;Andrea Forman;Rikki S. Gaber;Cassandra Gulden;Janice Horte;Jessica Long;Rachelle Lorenz Chambers;Terra Lucas;Shreshtha Madaan;Kristin Mattie;Danielle McKenna;Susan Montgomery;Sarah Nielsen;Jacquelyn Powers;Kim Rainey;Christina Rybak;Michelle Savage;Christina Seelaus;Jessica Stoll;Jill Stopfer;Shirley Yao;Susan Domchek;Erin Hahn;Corrine Munoz-Plaza;Jianjin Wang;Jazmine Garcia Delgadillo;Brian Mittman;Michael Gould;Shuting (Lily) Liang;Michelle C. Kegler;Megan Cotter;Emily Phillips;April Hermstad;Rentonia Morton;Derrick Beasley;Jeremy Martinez;Kara Riehman;David Gustafson;Lisa Marsch;Louise Mares;Andrew Quanbeck;Fiona McTavish;Helene McDowell;Randall Brown;Chantelle Thomas;Joseph Glass;Joseph Isham;Dhavan Shah;Jane Liebschutz;Karen Lasser;Katherine Watkins;Allison Ober;Sarah Hunter;Karen Lamp;Brett Ewing;Juliet Iwelunmor;Joyce Gyamfi;Sarah Blackstone;Nana Kofi Quakyi;Jacob Plange-Rhule;Gbenga Ogedegbe;Pritika Kumar;Nancy Van Devanter;Nam Nguyen;Linh Nguyen;Trang Nguyen;Nguyet Phuong;Donna Shelley;Sian Rudge;Etienne Langlois;Andrea Tricco;Sherry Ball;Anne Lambert-Kerzner;Christine Sulc;Carol Simmons;Jeneen Shell-Boyd;Taryn Oestreich;Ashley O’Connor;Emily Neely;Marina McCreight;Amy Labebue;Doreen DiFiore;Diana Brostow;P. Michael Ho;David Aron;Jillian Harvey;Megan McHugh;Dennis Scanlon;Rebecca Lee;Erica Soltero;Nathan Parker;Lorna McNeill;Tracey Ledoux;Jessie-Lee McIsaac;Kate MacLeod;Nicole Ata;Sherry Jarvis;Sara Kirk;Jonathan Purtle;Elizabeth Dodson;Ross Brownson;Brian Mittman;Geoffrey Curran;Geoffrey Curran;Jeffrey Pyne;Gregory Aarons;Mark Ehrhart;Elisa Torres;Edward Miech;Edward Miech;Kathleen Stevens;Alison Hamilton;Deborah Cohen;Deborah Padgett;Alexandra Morshed;Rupa Patel;Beth Prusaczyk;David C. Aron;Divya Gupta;Sherry Ball;Rosa Hand;Jenica Abram;Taylor Wolfram;Molly Hastings;Sarah Moreland-Russell;Rachel Tabak;Alex Ramsey;Ana Baumann;Emily Kryzer;Katherine Montgomery;Ericka Lewis;Margaret Padek;Byron Powell;Ross Brownson;Cezar Brian Mamaril;Glen Mays;Keith Branham;Lava Timsina;Glen Mays;Rachel Hogg;Abigail Fagan;Valerie Shapiro;Eric Brown;Kevin Haggerty;David Hawkins;Sabrina Oesterle;David Hawkins;Richard Catalano;Virginia McKay;M. Margaret Dolcini;Lee Hoffer;Tannaz Moin;Jinnan Li;O. Kenrik Duru;Susan Ettner;Norman Turk;Charles Chan;Abigail Keckhafer;Robert Luchs;Sam Ho;Carol Mangione;Peter Selby;Laurie Zawertailo;Nadia Minian;Dolly Balliunas;Rosa Dragonetti;Sarwar Hussain;Julia Lecce;Matthew Chinman;Joie Acosta;Patricia Ebener;Patrick S. Malone;Mary Slaughter;Darcy Freedman;Susan Flocke;Eunlye Lee;Kristen Matlack;Erika Trapl;Punam Ohri-Vachaspati;Morgan Taggart;Elaine Borawski;Amanda Parrish;Jeffrey Harris;Marlana Kohn;Kristen Hammerback;Becca McMillan;Peggy Hannon;Taren Swindle;Geoffrey Curran;Leanne Whiteside-Mansell;Wendy Ward;Cheryl Holt;Sheri Lou Santos;Erin Tagai;Mary Ann Scheirer;Roxanne Carter;Janice Bowie;Muhiuddin Haider;Jimmie Slade;Min Qi Wang;Andrew Masica;Gerald Ogola;Candice Berryman;Kathleen Richter;Rachel Shelton;Lina Jandorf;Deborah Erwin;Khoa Truong;Joyce R. Javier;Dean Coffey;Sheree M. Schrager;Lawrence Palinkas;Jeanne Miranda;Veda Johnson;Valerie Hutcherson;Ruth Ellis;Anna Kharmats;Sandra Marshall-King;Monica LaPradd;Fannie Fonseca-Becker;Deanna Kepka;Julia Bodson;Echo Warner;Brynn Fowler;Elizabeth Shenkman;William Hogan;Folakami Odedina;Jessica De Leon;Monica Hooper;Olveen Carrasquillo;Renee Reams;Myra Hurt;Steven Smith;Jose Szapocznik;David Nelson;Prabir Mandal;James Teufel
  • 通讯作者:
    James Teufel
Cross-Lingual Features for Alzheimer’s Dementia Detection from Speech
通过语音检测阿尔茨海默病的跨语言特征
  • DOI:
    10.21437/interspeech.2023-1934
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    4.8
  • 作者:
    Thomas Melistas;Lefteris Kapelonis;Nikos Antoniou;Petros Mitseas;Dimitris Sgouropoulos;Theodoros Giannakopoulos;Athanasios Katsamanis;Shrikanth Narayanan
  • 通讯作者:
    Shrikanth Narayanan

Shrikanth Narayanan的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Shrikanth Narayanan', 18)}}的其他基金

RI Core: Medium: Structured variability in vocal tract articulation dynamics in speech
RI 核心:中:言语中声道发音动态的结构变异
  • 批准号:
    2311676
  • 财政年份:
    2023
  • 资助金额:
    $ 50万
  • 项目类别:
    Standard Grant
RI: Small: Speaker-Specific Articulatory Strategies
RI:小:特定于说话者的发音策略
  • 批准号:
    1908865
  • 财政年份:
    2019
  • 资助金额:
    $ 50万
  • 项目类别:
    Continuing Grant
RI: Medium: Collaborative Research: Understanding Individual-Level Speech Variability: From Novel Articulatory Data to Robust Speaker Recognition
RI:媒介:协作研究:了解个体层面的语音变异性:从新颖的发音数据到强大的说话人识别
  • 批准号:
    1514544
  • 财政年份:
    2015
  • 资助金额:
    $ 50万
  • 项目类别:
    Continuing Grant
Be a Scientist!
成为一名科学家!
  • 批准号:
    1008372
  • 财政年份:
    2010
  • 资助金额:
    $ 50万
  • 项目类别:
    Continuing Grant
Collaborative Research: Computational Behavioral Science: Modeling, Analysis, and Visualization of Social and Communicative Behavior
合作研究:计算行为科学:社交和交流行为的建模、分析和可视化
  • 批准号:
    1029373
  • 财政年份:
    2010
  • 资助金额:
    $ 50万
  • 项目类别:
    Continuing Grant
RI: Large: An Integrated Approach to Creating Context Enriched Speech Translation Systems
RI:大型:创建上下文丰富的语音翻译系统的集成方法
  • 批准号:
    0911009
  • 财政年份:
    2009
  • 资助金额:
    $ 50万
  • 项目类别:
    Continuing Grant
SGER: Exploring Emotional Vocal Productions Through the Use of Real-Time Magnetic Resonance Imaging
SGER:通过使用实时磁共振成像探索情感声音作品
  • 批准号:
    0844243
  • 财政年份:
    2008
  • 资助金额:
    $ 50万
  • 项目类别:
    Standard Grant
Collaborative Research: Modeling Creative and Emotive Improvisation in Theater Performance
合作研究:模拟戏剧表演中的创意和情感即兴创作
  • 批准号:
    0757414
  • 财政年份:
    2008
  • 资助金额:
    $ 50万
  • 项目类别:
    Standard Grant
IERI: Collaborative Research: Automating Early Assessment of Academic Standards for Very Young Native and Non-Native Speakers of American English
IERI:合作研究:对美国英语为母语和非母语的幼儿进行学术标准早期评估自动化
  • 批准号:
    0326228
  • 财政年份:
    2003
  • 资助金额:
    $ 50万
  • 项目类别:
    Standard Grant
ITR: A User-centric Content-based Approach to Indexing, Query and Retrieval of Music through Signal Processing and Knowledge-based Methods
ITR:一种以用户为中心、基于内容的方法,通过信号处理和基于知识的方法对音乐进行索引、查询和检索
  • 批准号:
    0219912
  • 财政年份:
    2002
  • 资助金额:
    $ 50万
  • 项目类别:
    Continuing Grant

相似国自然基金

Galaxy Analytical Modeling Evolution (GAME) and cosmological hydrodynamic simulations.
  • 批准号:
  • 批准年份:
    2025
  • 资助金额:
    10.0 万元
  • 项目类别:
    省市级项目

相似海外基金

RII Track-4: NSF: An Integrated Multiphysics Machine Learning Modeling and Experimental Framework for Optimizing Micro-Needle Patches
RII Track-4:NSF:用于优化微针贴片的集成多物理场机器学习建模和实验框架
  • 批准号:
    2229555
  • 财政年份:
    2023
  • 资助金额:
    $ 50万
  • 项目类别:
    Standard Grant
Optimizing HPV vaccination programs in Low- and Middle-Income Countries (LMIC) and High-Income Countries (HIC) to reduce inequalities and reach global elimination of cervical cancer: An integrated knowledge translation dynamic-modeling approach
优化中低收入国家 (LMIC) 和高收入国家 (HIC) 的 HPV 疫苗接种计划,以减少不平等并实现全球消除宫颈癌:综合知识转化动态建模方法
  • 批准号:
    495110
  • 财政年份:
    2023
  • 资助金额:
    $ 50万
  • 项目类别:
    Operating Grants
Optimizing the sustainability of car sharing using mathematical modeling
使用数学模型优化汽车共享的可持续性
  • 批准号:
    EP/Y008014/1
  • 财政年份:
    2023
  • 资助金额:
    $ 50万
  • 项目类别:
    Research Grant
Optimizing Mpox surveillance strategies and preventing epidemic resurgence: a three-province mathematical modeling study
优化MPox监测策略并防止流行复发:三省数学模型研究
  • 批准号:
    481133
  • 财政年份:
    2023
  • 资助金额:
    $ 50万
  • 项目类别:
    Operating Grants
Modeling and simulation tools for optimizing design of network-informed clinical trials of combination HIV prevention interventions
用于优化 HIV 预防联合干预措施的网络信息临床试验设计的建模和模拟工具
  • 批准号:
    10622168
  • 财政年份:
    2022
  • 资助金额:
    $ 50万
  • 项目类别:
Optimizing Age-based Anal Cancer Screening Among People Living with HIV using Decision Analytic Modeling
使用决策分析模型优化艾滋病毒感染者中基于年龄的肛门癌筛查
  • 批准号:
    10775089
  • 财政年份:
    2022
  • 资助金额:
    $ 50万
  • 项目类别:
Optimizing Muscular Dystrophy Clinical Trial Designs using Modeling and Simulation
使用建模和仿真优化肌营养不良症临床试验设计
  • 批准号:
    10292052
  • 财政年份:
    2021
  • 资助金额:
    $ 50万
  • 项目类别:
Optimizing Muscular Dystrophy Clinical Trial Designs using Modeling and Simulation
使用建模和仿真优化肌营养不良症临床试验设计
  • 批准号:
    10470246
  • 财政年份:
    2021
  • 资助金额:
    $ 50万
  • 项目类别:
Optimizing colorectal cancer prevention: a multi-disciplinary, population-based investigation of serrated polyps using risk prediction and modeling
优化结直肠癌预防:利用风险预测和建模对锯齿状息肉进行多学科、基于人群的调查
  • 批准号:
    10436886
  • 财政年份:
    2020
  • 资助金额:
    $ 50万
  • 项目类别:
Modeling and Optimizing Design of Sensor Array Using Elastomeric Metamaterial
使用弹性超材料对传感器阵列进行建模和优化设计
  • 批准号:
    554049-2020
  • 财政年份:
    2020
  • 资助金额:
    $ 50万
  • 项目类别:
    University Undergraduate Student Research Awards
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了