Merging Neuroimaging and Multimedia: Methods, Opportunities, and Challenges
Merging Neuroimaging and Multimedia: Methods, Opportunities, and Challenges
复制标题
融合神经影像和多媒体：方法、机遇和挑战
DOI：
10.1109/thms.2013.2296871
复制
发表时间：
2014-02
影响因子：
3.6
通讯作者：
Guo Lei
中科院分区：
文献类型：
--
作者：
Liu Tianming;Hu Xintao;Li Xiaojin;Chen Mo;Han Junwei;Guo Lei
神经影像学和脑映射可以为多媒体分析提供有意义的指导。先进的计算多媒体分析可以用来更好地理解人脑的功能机制。从本质上讲，脑成像和脑映射技术可以作为一个桥梁，连接多媒体的数字表示和感知和理解其内容。本文总结了将脑成像与多媒体分析相结合的方法，并讨论了这一跨学科领域的机遇和挑战。一般来说，在多媒体理解过程中大脑反应的定量建模已经推进了基于内容的多媒体研究，如图像和视频分类和标记。多媒体分析通过在神经成像过程中使用自然的多媒体作为刺激，促进了功能脑映射。在合并神经成像和多媒体的挑战和机遇包括大脑的反应的量化，多媒体的量化，以及大脑的反应和计算多媒体功能之间的映射。
Neuroimaging and brain mapping can provide meaningful guidance to multimedia analyses. and advanced computational multimedia analysis can be used to better understand the functional mechanisms of the human brain. Essentially, brain imaging and brain mapping techniques can serve as a bridge that links the digital representation of multimedia and the perception and comprehension of its content. This paper summarizes methods that integrate brain imaging with multimedia analysis and discusses the opportunities and challenges in this interdisciplinary field. In general, quantitative modeling of brain responses during multimedia comprehension has advanced content-based multimedia studies such as image and video classification and tagging. Multimedia analysis has promoted functional brain mapping by using naturalistic multimedia as stimuli during neuroimaging. Challenges and opportunities in merging neuroimaging and multimedia include the quantification of the brain's responses, the quantification of multimedia, and the mapping between brain responses and computational multimedia features.
登录
查看更多内容
影响因子：
9.2
作者：
Nishimoto, Shinji;Vu, An T.;Naselaris, Thomas;Benjamini, Yuval;Yu, Bin;Gallant, Jack L.
通讯作者：
Gallant, Jack L.
影响因子：
6
作者：
Huang, Yonghong;Erdogmus, Deniz;Hild, Kenneth E., II
通讯作者：
Hild, Kenneth E., II
影响因子：
2.5
作者：
K. Whittingstall;A. Bartels;Vanessa Singh;Soyoung Kwon;N. Logothetis
通讯作者：
K. Whittingstall;A. Bartels;Vanessa Singh;Soyoung Kwon;N. Logothetis
DOI：
10.1109/tpami.2011.272
发表时间：
2012-10-01
影响因子：
23.6
作者：
Goferman, Stas;Zelnik-Manor, Lihi;Tal, Ayellet
通讯作者：
Tal, Ayellet
DOI：
10.1523/jneurosci.4743-11.2011
发表时间：
2011-11
期刊：
The Journal of Neuroscience
影响因子：
--
作者：
Ulla Martens;N. Trujillo-Barreto;T. Gruber
通讯作者：
Ulla Martens;N. Trujillo-Barreto;T. Gruber