Creating and Evaluating New Media Interfaces for Expression
创建和评估新的表达媒体界面
基本信息
- 批准号:RGPIN-2020-07054
- 负责人:
- 金额:$ 3.5万
- 依托单位:
- 依托单位国家:加拿大
- 项目类别:Discovery Grants Program - Individual
- 财政年份:2020
- 资助国家:加拿大
- 起止时间:2020-01-01 至 2021-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
I propose to push the boundaries of two forms of interactive visual media to increase the capacity for humans to learn and work together. First, new forms of interaction with a novel 3D display will be investigated. Second, advanced interactive, collaborative video (IV) with three critical new affordances to elevate video to be a first-class' learning medium will be created.
First, research using our 3D fish-tank virtual reality (FTVR) spherical display (3DD) focuses on two main types of interactions: 1) co-located and remote multi-person interaction requiring real-time 3D capture, and 2) human-3D agent interaction. To support co-located four-person interaction, a curved polarizing lens will be created to match the curvature of the spherical display surface coupled to active glasses to enable four different monoscopic perspective corrected views to be projected on the display but seen by different users. These displays provide virtual contents anchored to real-world coordinates allowing everyone to share a common reference frame. Thus, deictic interactions, like pointing and saying “That thing there.” are supported where everyone can see what is being pointed at. For remote participants, a real-time 3D capture system using depth cameras supporting eye-contact will be created. Perceptual effects as well as task performance on 3D tasks will be studied and compared to similar configurations using flat screens. Second, viewer and room interaction with an intelligent virtual agent (IVA) inside the spherical display will be studied. As with real-participants, voice and gesture interaction will investigated. Likewise, interaction semantics for collaborative pointing, selecting, translating, and rotating content will be explored in remote and co-located scenarios. This research will create advanced 3D spherical displays for groups of people and agents to work and play across space and time.
Second, from past work, we discovered three video affordances critical for education are missing: mutability, bidirectionality and interoperability. For mutability, interfaces for collaborative video making while each state change and annotation is managed will be created. For interoperability, interfaces supporting video structure and semantic capture and copy for effective integration with students' information ecology, including notes will be created. For bidirectionality, rich referencing interfaces enabling complex methods of communicating with video elements will be investigated. These interactions will be studied in educational scenarios such as: note taking, presenting, and social learning. Ultimately, the goal of this research provides the pen and paper' for video so people can learn to read/watch and write/compose' video as easily as they can through text.
This research directly involves 33 highly qualified personnel working in world-class international, interdisciplinary teams to become leaders in advanced media interaction.
我建议推动两种形式的互动视觉媒体的界限,以提高人类学习和共同工作的能力。首先,将研究与新型3D显示器的新交互形式。第二,先进的互动,协作视频(四)与三个关键的新的启示,以提升视频成为一流的学习媒体将被创建。
首先,使用我们的3D鱼缸虚拟现实(FTVR)球形显示器(3DD)的研究集中在两种主要类型的交互:1)共同定位和远程多人交互需要实时3D捕捉,2)人-3D代理交互。为了支持协同定位的四人交互,将创建弯曲偏振透镜以匹配耦合到有源眼镜的球形显示表面的曲率,以使得四个不同的单视场透视校正视图能够被投影在显示器上但被不同的用户看到。这些显示器提供锚定到真实世界坐标的虚拟内容,允许每个人共享一个共同的参考框架。因此,指示语的互动,比如指向并说“那个东西在那里。”在每个人都能看到所指向的地方得到支持。对于远程参与者,将创建一个使用深度相机支持眼神接触的实时3D捕获系统。感知效果以及对3D任务的任务性能将进行研究,并与使用平面屏幕的类似配置进行比较。其次,观众和房间的互动与智能虚拟代理(IVA)内的球形显示器将进行研究。与真实参与者一样,语音和手势交互将被研究。同样,协作指向,选择,翻译和旋转内容的交互语义将在远程和协同定位的情况下进行探索。这项研究将为一群人和代理人创造先进的3D球形显示器,以跨空间和时间工作和娱乐。
其次,从过去的工作中,我们发现三个视频启示教育的关键是失踪:可变性,双向性和互操作性。对于可变性,将创建用于协作视频制作的接口,同时管理每个状态更改和注释。为了实现互操作性,将创建支持视频结构和语义捕获和复制的接口,以便与学生的信息生态(包括笔记)进行有效整合。对于双向性,将研究能够实现与视频元素通信的复杂方法的丰富参考接口。这些互动将在教育场景中进行研究,例如:笔记,演示和社交学习。最终,这项研究的目标是为视频提供笔和纸,这样人们就可以像通过文本一样轻松地学习阅读/观看和写作/撰写视频。
这项研究直接涉及33名高素质的人员,他们在世界一流的国际跨学科团队中工作,成为先进媒体互动的领导者。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Fels, Sidney其他文献
Dysfunctional paraspinal muscles in adult spinal deformity patients lead to increased spinal loading.
- DOI:
10.1007/s00586-022-07292-x - 发表时间:
2022-09 - 期刊:
- 影响因子:2.8
- 作者:
Malakoutian, Masoud;Noonan, Alex M.;Dehghan-Hamani, Iraj;Yamamoto, Shun;Fels, Sidney;Wilson, David;Doroudi, Majid;Schutz, Peter;Lewis, Stephen;Ailon, Tamir;Street, John;Brown, Stephen H. M.;Oxland, Thomas R. - 通讯作者:
Oxland, Thomas R.
Characterizing Motor Control of Mastication With Soft Actor-Critic
- DOI:
10.3389/fnhum.2020.00188 - 发表时间:
2020-05-26 - 期刊:
- 影响因子:2.9
- 作者:
Abdi, Amir H.;Sagl, Benedikt;Fels, Sidney - 通讯作者:
Fels, Sidney
A framework for evaluating usability of clinical monitoring technology.
- DOI:
10.1007/s10877-007-9091-y - 发表时间:
2007-10-01 - 期刊:
- 影响因子:2.2
- 作者:
Daniels, Jeremy;Fels, Sidney;Ansermino, J Mark - 通讯作者:
Ansermino, J Mark
Optimizing Multiple Object Tracking and Best View Video Synthesis
- DOI:
10.1109/tmm.2008.2001379 - 发表时间:
2008-10-01 - 期刊:
- 影响因子:7.3
- 作者:
Jiang, Hao;Fels, Sidney;Little, James J. - 通讯作者:
Little, James J.
FRANK: A HYBRID 3D BIOMECHANICAL MODEL OF THE HEAD AND NECK
- DOI:
10.1016/b978-0-12-804009-6.00020-1 - 发表时间:
2017-01-01 - 期刊:
- 影响因子:0
- 作者:
Anderson, Peter;Fels, Sidney;Tang, Keyi - 通讯作者:
Tang, Keyi
Fels, Sidney的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Fels, Sidney', 18)}}的其他基金
Creating and Evaluating New Media Interfaces for Expression
创建和评估新的表达媒体界面
- 批准号:
RGPIN-2020-07054 - 财政年份:2022
- 资助金额:
$ 3.5万 - 项目类别:
Discovery Grants Program - Individual
Creating and Evaluating New Media Interfaces for Expression
创建和评估新的表达媒体界面
- 批准号:
RGPIN-2020-07054 - 财政年份:2021
- 资助金额:
$ 3.5万 - 项目类别:
Discovery Grants Program - Individual
Creation and Evaluation of Novel Media Experiences
新颖媒体体验的创造和评估
- 批准号:
RGPIN-2015-04971 - 财政年份:2019
- 资助金额:
$ 3.5万 - 项目类别:
Discovery Grants Program - Individual
An investigation of a ViDeX interface in onenote to provide video experience for learning
Onenote 中 ViDeX 界面的研究,为学习提供视频体验
- 批准号:
508852-2017 - 财政年份:2019
- 资助金额:
$ 3.5万 - 项目类别:
Collaborative Research and Development Grants
Creation and Evaluation of Novel Media Experiences
新颖媒体体验的创造和评估
- 批准号:
RGPIN-2015-04971 - 财政年份:2018
- 资助金额:
$ 3.5万 - 项目类别:
Discovery Grants Program - Individual
An investigation of a ViDeX interface in onenote to provide video experience for learning
Onenote 中 ViDeX 界面的研究,为学习提供视频体验
- 批准号:
508852-2017 - 财政年份:2018
- 资助金额:
$ 3.5万 - 项目类别:
Collaborative Research and Development Grants
Control strategies for articulatory speech synthesis for natural user interfaces
自然用户界面的发音语音合成控制策略
- 批准号:
506576-2017 - 财政年份:2018
- 资助金额:
$ 3.5万 - 项目类别:
Strategic Projects - Group
Creation and Evaluation of Novel Media Experiences
新颖媒体体验的创造和评估
- 批准号:
RGPIN-2015-04971 - 财政年份:2017
- 资助金额:
$ 3.5万 - 项目类别:
Discovery Grants Program - Individual
Control strategies for articulatory speech synthesis for natural user interfaces
自然用户界面的发音语音合成控制策略
- 批准号:
506576-2017 - 财政年份:2017
- 资助金额:
$ 3.5万 - 项目类别:
Strategic Projects - Group
Optical motion tracking system for Human Modelling and Virtual Reality
用于人体建模和虚拟现实的光学运动跟踪系统
- 批准号:
RTI-2018-00731 - 财政年份:2017
- 资助金额:
$ 3.5万 - 项目类别:
Research Tools and Instruments
相似海外基金
Evaluating the Atmospheric Dynamics of Nitrate and Sulfate in Southern New England in Response to Emission Regulations
评估新英格兰南部硝酸盐和硫酸盐的大气动态以响应排放法规
- 批准号:
2414561 - 财政年份:2024
- 资助金额:
$ 3.5万 - 项目类别:
Continuing Grant
Development of a new method for evaluating gut microbiota that can be evaluated in a simple, low-cost, and short time
开发一种评估肠道微生物群的新方法,可以在短时间内进行简单、低成本的评估
- 批准号:
23K08476 - 财政年份:2023
- 资助金额:
$ 3.5万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Developing and evaluating new measures of family availability to provide care to people with dementia
制定和评估家庭可用性的新衡量标准,为痴呆症患者提供护理
- 批准号:
10728725 - 财政年份:2023
- 资助金额:
$ 3.5万 - 项目类别:
Integrated Supportive Care Policies to Improve Maternal Health Equity: Evaluating the Multi-level Effects and Implementation of Doula Programs for Medicaid-Eligible Birthing People in New York City
改善孕产妇健康公平的综合支持性护理政策:评估纽约市符合医疗补助资格的新生儿导乐计划的多层次影响和实施情况
- 批准号:
10833919 - 财政年份:2023
- 资助金额:
$ 3.5万 - 项目类别:
Establishment of a new fetal management method by evaluating integration of fetal distress during delivery for clinical application
评估分娩过程中胎儿窘迫的整合,建立新的胎儿管理方法并应用于临床
- 批准号:
23K15849 - 财政年份:2023
- 资助金额:
$ 3.5万 - 项目类别:
Grant-in-Aid for Early-Career Scientists
Collaborative Research: Evaluating the contribution of small eukaryotes to nitrate-based new production in the North Pacific Subtropical Gyre
合作研究:评估小型真核生物对北太平洋副热带环流硝酸盐新生产的贡献
- 批准号:
2219973 - 财政年份:2022
- 资助金额:
$ 3.5万 - 项目类别:
Standard Grant
Creating and Evaluating New Media Interfaces for Expression
创建和评估新的表达媒体界面
- 批准号:
RGPIN-2020-07054 - 财政年份:2022
- 资助金额:
$ 3.5万 - 项目类别:
Discovery Grants Program - Individual
EO4AgroClimate: Evaluating the structure and evolution of Australian East Coast Lows using a new Southern Hemisphere cyclone atlas
EO4AgroClimate:使用新的南半球气旋图集评估澳大利亚东海岸低压的结构和演变
- 批准号:
ST/X000087/1 - 财政年份:2022
- 资助金额:
$ 3.5万 - 项目类别:
Research Grant
Improving safety in forensic mental health hospitals: Examining current practices and evaluating a new risk assessment tool to prevent patient violence
提高法医精神卫生医院的安全性:检查当前做法并评估新的风险评估工具以防止患者暴力
- 批准号:
474471 - 财政年份:2022
- 资助金额:
$ 3.5万 - 项目类别:
Studentship Programs
A New Translational Rat Model for Evaluating Anti-Aging Interventions
用于评估抗衰老干预措施的新转化大鼠模型
- 批准号:
10665539 - 财政年份:2022
- 资助金额:
$ 3.5万 - 项目类别: