Human Perception & Intelligence in Multimedia Computing

人类感知

基本信息

  • 批准号:
    RGPIN-2018-04367
  • 负责人:
  • 金额:
    $ 3.17万
  • 依托单位:
  • 依托单位国家:
    加拿大
  • 项目类别:
    Discovery Grants Program - Individual
  • 财政年份:
    2018
  • 资助国家:
    加拿大
  • 起止时间:
    2018-01-01 至 2019-12-31
  • 项目状态:
    已结题

项目摘要

Human Perception and Intelligence in Multimedia Computing – ******Human intelligence has been driving the advancement of technology. Current state-of-the-art in the research community focuses on simulating human intelligence in a machine executable form. Machine learning methods show promise but also bring challenges due to massive training data and lengthy training time. To address these issues, it is necessary to optimize the training features using robust computer vision and signal processing techniques before the machine learning step. Otherwise, noisy and irrelevant input will lead to exponential computational time or even non-convergence in the machine training process. My research goal is to remove redundant data, identify dominant features, and introduce unsupervised algorithms to deliver intelligent multimedia computing results. ******Selecting dominant features in multimedia, e.g., image, video, signal and graphics, requires data and pattern analysis (from 1D to higher dimensions) in the spatial and temporal domain. It has been shown in the literature that a computational model incorporating human perceptual criteria, e.g., color and contrast sensitivity, is effective in feature discovery, data discrimination and target recognition. To conduct research using the rapidly growing dynamic and complex multimedia data, I will extend my perceptually motivated models and focus on introducing efficient methods in Multimedia Quality Assessment, Noise Discrimination and Multi-Modal Fusion. Dimensionality Reduction techniques will also be developed to optimize performance. ******Determination of Just-Noticeable-Difference (JND) is an important step when assessing output quality and discriminating noise. Application-specific JND threshold (or tolerance), e.g., for game applications or medical image analysis, needs to be defined in order to decide whether an output quality should be accepted or rejected. Multimedia data is represented as digital values in machines, while visual cue is interpreted based on the Human Visual System (HVS). A change in digital value may not be visible by the HVS, but such change can be an application alert. On the other hand, a visible change to the HVS is not necessarily significant for an application. The result of my study will bring further insight into the correspondence between quantitative computer output and qualitative visual assessment, and report impact which is significant to an application. ******My work on quality assessment, noise filtering and multi-modal fusion will help track changing patterns in dynamic multimedia data. Applications will include smart city monitoring, e.g., surveillance and target tracking, and the prediction of structural or geographical changes before disasters occur, e.g., landslides.
多媒体计算中的人类感知和智能--人类的智能一直在推动技术的进步。目前,研究界最先进的技术集中在以机器可执行的形式模拟人类智能。机器学习方法前景看好,但由于训练数据量大、训练时间长,也带来了挑战。为了解决这些问题,有必要在机器学习步骤之前使用稳健的计算机视觉和信号处理技术来优化训练特征。否则,噪声和无关的输入将导致机器训练过程中的指数计算时间,甚至不收敛。我的研究目标是去除冗余数据,识别主要特征,并引入非监督算法来交付智能多媒体计算结果。*选择多媒体中的主要特征,例如图像、视频、信号和图形,需要在空间和时间域中进行数据和模式分析(从一维到更高的维度)。已有文献表明,包含人类感知标准(例如颜色和对比度敏感性)的计算模型在特征发现、数据识别和目标识别中是有效的。为了利用快速增长的动态和复杂的多媒体数据进行研究,我将扩展我的感知激励模型,并重点介绍多媒体质量评估、噪声识别和多模式融合的有效方法。还将开发降维技术以优化性能。在评价输出质量和区分噪声时,确定刚可察觉差(JND)是一个重要的步骤。需要定义特定于应用的JND阈值(或容差),例如用于游戏应用或医学图像分析,以便决定是否应该接受或拒绝输出质量。多媒体数据在机器中表示为数字值,而视觉提示则基于人类视觉系统(HVS)进行解释。HVS可能看不到数字值的变化,但这种变化可以是应用程序警报。另一方面,对HVS的明显更改对应用程序来说不一定很重要。我的研究结果将使我们进一步深入了解定量计算机输出与定性视觉评估之间的对应关系,并报告对应用程序具有重要意义的影响。*我在质量评估、噪声过滤和多模式融合方面的工作将有助于跟踪动态多媒体数据中的变化模式。应用将包括智能城市监测,例如监视和目标跟踪,以及在灾害发生之前预测结构或地理变化,例如山体滑坡。

项目成果

期刊论文数量(0)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

Cheng, Irene其他文献

A Hybrid Knowledge-Guided Detection Technique for Screening of Infectious Pulmonary Tuberculosis From Chest Radiographs
Robust MRI abnormality detection using background noise removal with polyfit surface evolution
Estimation of Atmospheric Dry and Wet Deposition of Particulate Elements at Four Monitoring Sites in the Canadian Athabasca Oil Sands Region
  • DOI:
    10.1029/2021jd035787
  • 发表时间:
    2022-02-16
  • 期刊:
  • 影响因子:
    4.4
  • 作者:
    Al Mamun, Abdulla;Cheng, Irene;Charland, Jean-Pierre
  • 通讯作者:
    Charland, Jean-Pierre
Real-Time Runway Detection for Infrared Aerial Image Using Synthetic Vision and an ROI Based Level Set Method
  • DOI:
    10.3390/rs10101544
  • 发表时间:
    2018-10-01
  • 期刊:
  • 影响因子:
    5
  • 作者:
    Liu, Changjiang;Cheng, Irene;Basu, Anup
  • 通讯作者:
    Basu, Anup
Uncertainty Assessment of Gaseous Oxidized Mercury Measurements Collected by Atmospheric Mercury Network
  • DOI:
    10.1021/acs.est.6b04926
  • 发表时间:
    2017-01-17
  • 期刊:
  • 影响因子:
    11.4
  • 作者:
    Cheng, Irene;Zhang, Leiming
  • 通讯作者:
    Zhang, Leiming

Cheng, Irene的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('Cheng, Irene', 18)}}的其他基金

Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2022
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2021
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Displacement updates in dynamic areas
动态区域的位移更新
  • 批准号:
    543428-2019
  • 财政年份:
    2020
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Collaborative Research and Development Grants
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2020
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    DGDND-2018-00020
  • 财政年份:
    2020
  • 资助金额:
    $ 3.17万
  • 项目类别:
    DND/NSERC Discovery Grant Supplement
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    DGDND-2018-00020
  • 财政年份:
    2019
  • 资助金额:
    $ 3.17万
  • 项目类别:
    DND/NSERC Discovery Grant Supplement
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2019
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    DGDND-2018-00020
  • 财政年份:
    2018
  • 资助金额:
    $ 3.17万
  • 项目类别:
    DND/NSERC Discovery Grant Supplement
Perceptually Enhanced Multimedia Data Acquisition, Processing, Transmission and Visualization
感知增强的多媒体数据采集、处理、传输和可视化
  • 批准号:
    RGPIN-2015-04232
  • 财政年份:
    2015
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual

相似海外基金

Glass-box Deep Machine Perception for Trustworthy Artificial Intelligence
玻璃盒深度机器感知,实现值得信赖的人工智能
  • 批准号:
    DE230101058
  • 财政年份:
    2023
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Early Career Researcher Award
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2022
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2021
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2020
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Research development of the super leading safe and smart next generation robot based on breakthrough superior wideband force perception and outstanding robot artificial intelligence
基于突破性的卓越宽带力感知和卓越的机器人人工智能研发超领先的安全智能下一代机器人
  • 批准号:
    20K14713
  • 财政年份:
    2020
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Grant-in-Aid for Early-Career Scientists
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    DGDND-2018-00020
  • 财政年份:
    2020
  • 资助金额:
    $ 3.17万
  • 项目类别:
    DND/NSERC Discovery Grant Supplement
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    DGDND-2018-00020
  • 财政年份:
    2019
  • 资助金额:
    $ 3.17万
  • 项目类别:
    DND/NSERC Discovery Grant Supplement
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    RGPIN-2018-04367
  • 财政年份:
    2019
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
Human Perception & Intelligence in Multimedia Computing
人类感知
  • 批准号:
    DGDND-2018-00020
  • 财政年份:
    2018
  • 资助金额:
    $ 3.17万
  • 项目类别:
    DND/NSERC Discovery Grant Supplement
Intelligence machine vision system based of visual perception
基于视觉感知的智能机器视觉系统
  • 批准号:
    155518-1994
  • 财政年份:
    1997
  • 资助金额:
    $ 3.17万
  • 项目类别:
    Discovery Grants Program - Individual
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了