Multi-Modality-Enriched Video: Potential, Strategies and Applications
多模态丰富视频:潜力、策略和应用
基本信息
- 批准号:RGPIN-2015-06637
- 负责人:
- 金额:$ 1.82万
- 依托单位:
- 依托单位国家:加拿大
- 项目类别:Discovery Grants Program - Individual
- 财政年份:2016
- 资助国家:加拿大
- 起止时间:2016-01-01 至 2017-12-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Visual sensors are ubiquitous and have found their ways into many different applications. They capturing data at an incredible pace and are being integrated with other sensors into single devices. For example a typical smartphone has a camera (visual sensor), a GPS sensor, an accelerometer, a gyroscope, and a magnetometer. These consolidated sensors generate multi-modality-enriched video signal: video signal as well as one or multiple 1-D or 2-D non-video signals. The non-video signals can provide additional context for video signal processing or directly provide side information to facilitate video signal processing and communication. For example a motion sensor can provide motion data useful for motion estimation and thus video compression. Moreover, multi-modality enriched video enables us to develop new functionalities and create new user experiences. The enriching non-video signals have a tremendous potential for improving the way we communicate and make decision based on video. However, realization of this potential hinges upon advancement in techniques for managing, analyzing, and extracting useful information from these multi-modality data sets. Our utilization of interdependency between different signal modality acquired by enriched visual sensors is rather intuitive. Currently, there is no established rationale for determining if there are any benefits to use more than one signal modality in a particular video processing task (e.g. video compression, detection, tracking) and which one to use and how to use it. In this Discovery Grant research, a new line of inquiry will be pursued in order to systematically utilize the inter dependencies between different signal modalities for video compression, post processing, detection and classification. A tensor based framework will be adopted that will characterize the interaction between sensing modalities. The proposed research is expected to yield new approaches for systematic analysis and processing of multi-modality enriched video. The research will lead to superior video communication and better video-based tracking, recognition and classifications. The new knowledge arising from this research will find its way into new technologies and products in areas of great importance to Canada such as education, healthcare, manufacturing and auto industry. Canadian companies in this area will benefit from the new knowledge and also the highly qualified personnel that will participate in the research.
视觉传感器无处不在,并且已经找到了它们进入许多不同应用的方式。它们以令人难以置信的速度捕获数据,并与其他传感器集成到单个设备中。例如,典型的智能电话具有相机(视觉传感器)、GPS传感器、加速度计、陀螺仪和磁力计。这些整合的传感器生成多模态丰富的视频信号:视频信号以及一个或多个1-D或2-D非视频信号。非视频信号可以提供用于视频信号处理的附加上下文或直接提供辅助信息以促进视频信号处理和通信。例如,运动传感器可以提供对运动估计以及因此对视频压缩有用的运动数据。此外,多模态丰富的视频使我们能够开发新的功能并创造新的用户体验。丰富的非视频信号具有巨大的潜力,可以改善我们基于视频进行通信和决策的方式。然而,这种潜力的实现取决于用于管理、分析和从这些多模态数据集提取有用信息的技术的进步。我们利用丰富的视觉传感器获得的不同信号模态之间的相互依赖性是相当直观的。目前,还没有确定在特定的视频处理任务中使用一种以上的信号模态是否有任何好处的基本原理(例如视频压缩、检测、跟踪)以及使用哪一种以及如何使用它。在这项发现资助研究中,将进行一项新的调查,以便系统地利用不同信号模态之间的相互依赖性进行视频压缩,后处理、检测和分类。将采用基于张量的框架,该框架将表征感测模态之间的相互作用。该研究有望为多模态丰富视频的系统分析和处理提供新的方法。该研究将导致上级视频通信和更好的基于视频的跟踪,识别和分类。从这项研究中产生的新知识将在教育,医疗保健,制造业和汽车工业等对加拿大非常重要的领域中找到新技术和产品。这一领域的加拿大公司将受益于新的知识和参与研究的高素质人员。
项目成果
期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
数据更新时间:{{ journalArticles.updateTime }}
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Shirani, Shahram其他文献
Block-Based CS in a CMOS Image Sensor
- DOI:
10.1109/jsen.2012.2219143 - 发表时间:
2014-08-01 - 期刊:
- 影响因子:4.3
- 作者:
Dadkhah, Mohammadreza;Deen, M. Jamal;Shirani, Shahram - 通讯作者:
Shirani, Shahram
Neural network solution fora real-time no-reference video quality assessment of H.264/AVC video bitstreams
- DOI:
10.1007/s11042-021-10654-0 - 发表时间:
2021-10-27 - 期刊:
- 影响因子:3.6
- 作者:
Fazliani, Yasamin;Andrade, Ernesto;Shirani, Shahram - 通讯作者:
Shirani, Shahram
Affine motion prediction based on translational motion vectors
- DOI:
10.1109/tcsvt.2007.903777 - 发表时间:
2007-10-01 - 期刊:
- 影响因子:8.4
- 作者:
Kordasiewicz, Roman C.;Gallant, Michael D.;Shirani, Shahram - 通讯作者:
Shirani, Shahram
Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area
- DOI:
10.1109/tbme.2012.2228262 - 发表时间:
2013-02-01 - 期刊:
- 影响因子:4.6
- 作者:
Mirmahboub, Behzad;Samavi, Shadrokh;Shirani, Shahram - 通讯作者:
Shirani, Shahram
An approach to improve the signal-to-noise ratio of active pixel sensor for low-light-level applications
- DOI:
10.1109/ted.2006.881053 - 发表时间:
2006-09-01 - 期刊:
- 影响因子:3.1
- 作者:
Faramarzpour, Naser;Deen, M. Jamal;Shirani, Shahram - 通讯作者:
Shirani, Shahram
Shirani, Shahram的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Shirani, Shahram', 18)}}的其他基金
Enabling technologies of the video systems of future
未来视频系统的支持技术
- 批准号:
RGPIN-2020-06842 - 财政年份:2022
- 资助金额:
$ 1.82万 - 项目类别:
Discovery Grants Program - Individual
Enabling technologies of the video systems of future
未来视频系统的支持技术
- 批准号:
RGPIN-2020-06842 - 财政年份:2021
- 资助金额:
$ 1.82万 - 项目类别:
Discovery Grants Program - Individual
Contactless Vital Signs Measurement and Analysis Systems
非接触式生命体征测量和分析系统
- 批准号:
543650-2019 - 财政年份:2020
- 资助金额:
$ 1.82万 - 项目类别:
Collaborative Research and Development Grants
Enabling technologies of the video systems of future
未来视频系统的支持技术
- 批准号:
RGPIN-2020-06842 - 财政年份:2020
- 资助金额:
$ 1.82万 - 项目类别:
Discovery Grants Program - Individual
Contactless Vital Signs Measurement and Analysis Systems
非接触式生命体征测量和分析系统
- 批准号:
543650-2019 - 财政年份:2019
- 资助金额:
$ 1.82万 - 项目类别:
Collaborative Research and Development Grants
Multi-Modality-Enriched Video: Potential, Strategies and Applications
多模态丰富视频:潜力、策略和应用
- 批准号:
RGPIN-2015-06637 - 财政年份:2019
- 资助金额:
$ 1.82万 - 项目类别:
Discovery Grants Program - Individual
Multi-Modality-Enriched Video: Potential, Strategies and Applications
多模态丰富视频:潜力、策略和应用
- 批准号:
RGPIN-2015-06637 - 财政年份:2018
- 资助金额:
$ 1.82万 - 项目类别:
Discovery Grants Program - Individual
Audio-track classification using deep neural networks
使用深度神经网络进行音轨分类
- 批准号:
530283-2018 - 财政年份:2018
- 资助金额:
$ 1.82万 - 项目类别:
Engage Grants Program
Multi-Modality-Enriched Video: Potential, Strategies and Applications
多模态丰富视频:潜力、策略和应用
- 批准号:
RGPIN-2015-06637 - 财政年份:2017
- 资助金额:
$ 1.82万 - 项目类别:
Discovery Grants Program - Individual
Optimizing Video Quality Using Machine-Learning-Controlled Adaptive Resolution, Video Compression
使用机器学习控制的自适应分辨率、视频压缩来优化视频质量
- 批准号:
510255-2017 - 财政年份:2017
- 资助金额:
$ 1.82万 - 项目类别:
Engage Grants Program
相似海外基金
Comprehensive development strategy of modality-specific "intellectual property" and "cultivation" with an eye on "pharmaceutical affairs" in academia drug discovery
学术界新药研发着眼“药事”的模式“知识产权”与“培育”综合发展策略
- 批准号:
23K02551 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
MODSEM. Graded network activation and connectivity during semantic processing depending on modality
调制解调器。
- 批准号:
EP/Y014367/1 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Fellowship
Modality-independent representations of object shape in macaque inferotemporal cortex
猕猴下颞叶皮层物体形状的模态无关表示
- 批准号:
10679530 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
A Modality-Agnostic Potency Assay Enabling Both Ex Vivo and In Vivo Genome Editing Therapeutics for Sickle Cell Disease
一种与模态无关的效力测定,可实现镰状细胞病的体外和体内基因组编辑治疗
- 批准号:
10668694 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
CRII: RI: Modeling and Understanding the Invisible World in Thermal Modality
CRII:RI:用热模态建模和理解无形世界
- 批准号:
2334246 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Standard Grant
Development of multi-modality real-time tomographic imaging system using optical interference and photoacoustics
利用光学干涉和光声学的多模态实时断层成像系统的开发
- 批准号:
23K11823 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Offline to online and then back again: Assessing the ongoing impact of changes in classroom modality on student participation and experience in software engineering classes
线下到线上,然后再回来:评估课堂模式的变化对学生参与和软件工程课程体验的持续影响
- 批准号:
23K02808 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Grant-in-Aid for Scientific Research (C)
Clinical Translation of dual-modality transrectal ultrasound and photoacoustic imaging for detection of aggressive human prostate cancer
双模态经直肠超声和光声成像检测侵袭性人类前列腺癌的临床转化
- 批准号:
10802712 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Multi-scale and multi-modality imaging of neuropathology in VCID
VCID 神经病理学的多尺度、多模态成像
- 批准号:
10812034 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Conceptualization of mesenchymal stem cell-related diseases and elucidation of their etiology and treatment modality
间充质干细胞相关疾病的概念及其病因学和治疗方式的阐明
- 批准号:
23H03092 - 财政年份:2023
- 资助金额:
$ 1.82万 - 项目类别:
Grant-in-Aid for Scientific Research (B)