MRI: Development of a Cross-Platform Infrastructure for Natural Interaction Research

提案号：11-26570PI(s): Kong, Jun Cook, John R.；施,静;于楠机构：北达科他州立大学职称：核磁共振/开发自然交互研究的跨平台基础设施项目建议：该项目来自EPSCoR状态，旨在通过提供自动模态适应来开发支持自然交互研究的跨平台基础设施，从根本上改变人机交互（HCI）的范式。与之前的方法不同，该方法量化了每种模式的可用性，然后将适应问题形式化为寻找一组产生最高可用性的输入/输出模式，即优化问题。除了交互上下文，我们的方法还考虑了计算基础设施（例如，系统资源和网络）对模态适应的影响。拟议的工作在北达科他州建立了第一个自然交互实验室，使自适应自然交互的以下研究项目成为可能：-建立跨多个场景的公共交互环境，-建立设备感知的模态空间，-建立设备感知的可用性空间，以及-在人机交互环境中的服务质量。这项工作旨在通过提供跨多个设备的通用编程接口，为研究开发一个统一的基础设施。更广泛的影响：该仪器应该为教师和研究生提供一个独特的研究设施，以进行用户交互增强技术和教育的研究。该提案提高了EPSCoR州的博士学位生产，鼓励代表性不足的学生通过NATURE（培养美国部落本科生研究和教育）和WISMET（科学、数学、工程和技术领域的女性）项目进行研究，为本科生提供研究机会，并影响北达科他州的工业和经济发展。

Proposal #: 11-26570PI(s): Kong, Jun Cook, John R.; Shi, Jing; Yu, NanInstitution: North Dakota State UniversityTitle: MRI/Dev. : A Cross-Platform Infrastructure for Natural Interaction ResearchProject Proposed:This project from an EPSCoR state, aiming to develop a cross-platform infrastructure that supports natural interaction research by providing automatic modality adaptation, radically alters the paradigm for human/computer interaction (HCI). Distinct from previous approaches, the proposed approach quantifies the usability of each modality and then formalizes the adaptation issue as searching for a set of input/output modalities that produce the highest usability, i.e., an optimization issue. In addition to the interaction context, our approach also considers the effects of computing infrastructures (e.g., system resources and networking) on the modality adaptation. The proposed work establishes the first Natural Interaction Laboratory in North Dakota, enabling the following research projects in Adaptive Natural Interaction:- Establishing common interaction context across multiple scenarios,- Device-aware establishment of modality space,- Device-aware establishment of usability space, and- Quality of service in the human/computer interaction context.The work aims to develop a unifying infrastructure for research by providing a common programming interface across multiple devices. Broader Impacts: This instrumentation should provide a unique research facility for faculty and graduate students to conduct research on user interaction-enhancing technology and education. The proposal enhances PhD production in an EPSCoR state, encourages underrepresented students into research via the NATURE (Nurturing American Tribal Undergraduate Research and Educations) and WISMET (Women in Science, Math, Engineering, and Technology) programs, provides research opportunities to undergraduate students, and impacts industry and economic development in North Dakota.