Markerless Tracking of 3D Posture to Reveal the Sensory Origins of Body Schema

3D 姿势无标记跟踪揭示身体图式的感官起源

• 批准号: 10410450
• 负责人: Kyle Scott Severson
• 金额: $ 6.98万
• 依托单位: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
• 依托单位国家: 美国
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-06-01 至 2023-05-31
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10410450
• 关键词: 3-Dimensional; Address; Affect; Amputation; Anatomy; Animals; Area; Awareness; Behavior; Behavioral; Body part; Brain; Clinical; Code; Cognitive; Collaborations; Communities; Computer Analysis; Computer Vision Systems; Data Analyses; Deafferentation procedure; Disease; Educational workshop; Electrophysiology (science); Elements; Engineering; Environment; Excision; Experimental Models; Faculty; Feedback; Goals; Head; Health; Human; Individual; Intervention; Knowledge; Label; Learning; Limb Prosthesis; Limb structure; Locomotion; Machine Learning; Maintenance; Medical; Mentorship; Methodology; Methods; Modeling; Monitor; Motor; Movement; Mus; Neurobiology; Neurons; Operative Surgical Procedures; Parietal Lobe; Positioning Attribute; Posture; Process; Proxy; Reporting; Research; Research Training; Self Perception; Sensory; Somatosensory Cortex; Specialist; Speed; Stroke; System; Tactile; Talents; Technical Expertise; Techniques; Technology; Testing; Touch sensation; Training; Universities; Update; Vertebral column; base; brain machine interface; career; computational neuroscience; convolutional neural network; deep learning; design; experimental study; meetings; motor control; neural circuit; neural correlate; neuromechanism; novel; novel strategies; optogenetics; professor; relating to nervous system; research to practice; sensory input; skills; social cognition; somatosensory; stroke recovery; symposium; tenure track; tool

The goal of this proposed research is to reveal the sensory origins underlying the body schema representation. Body schema is the brain's internal model of the body's spatial configuration. This internal representation is critical for sensorimotor processing, movement control, and self-awareness, and is continuously updated during movement. Body schema representations are disrupted when somatosensory input is lost. The first step toward discover the neural correlates of body schema is to uncover neural mechanisms that generate body posture representation. We hypothesize that sensory inputs from primary somatosensory cortex (S1) and secondary somatosensory cortex (S2) to the posterior parietal cortex (PPC) are transformed to construct a body posture representation. To delineate the mechanisms underlying the neural coding of body posture, this project will utilize large- scale monitoring, apply interventional tools, develop new data analysis tools, and integrate new approaches. Our approach is to perform large-scale electrophysiological recording and novel markerless tracking of 3D posture in freely moving mice. To track posture, the first aim is to adapt a markerless tracking pipeline comprised of a deep 3D convolutional neural network to process high-speed videography of mouse behavior from multiple cameras. The second aim is to perform large-scale recording of neurons in S1, S2, and PPC and use advanced computational approaches to determine which postural features best explain the activity of neurons in these cortical areas. Finally, the third aim is to use optogenetic and projection-specific manipulations to address the causal impact of proprioceptive inputs from S1 and S2 on coding of posture in PPC. This research promises to uncover how sensory inputs are involved in generating the body schema representation and guiding behavior. Extensive training will be required to carry out this project and achieve my goal of earning a tenure-track professor position. The rigorous methodological and intellectual environment in Dr. Fan Wang’s lab and the Duke Neurobiology community will advance my conceptual knowledge and technical skills. I will implement deep learning techniques through training and collaboration with specialists. I will learn new techniques by attending Neuropixel and computational neuroscience courses. Finally, I will develop my professional skills by frequent attendance of seminars, workshops, and meeting with a postdoctoral mentorship committee. The proposed project will be conducted in the Department of Neurobiology at the Duke University Medical Campus. This interdisciplinary community at Duke will bolster the research and training included in this application through frequent interaction with talented and collaborative faculty, organization of seminars and symposia, numerous opportunities to practice research talks and receive valuable feedback, formation of a personalized postdoctoral mentorship committee, extensive career and professional training, and invaluable support from the postdoctoral association.

这项拟议的研究的目标是揭示身体图式背后的感觉起源 代表权。身体图式是大脑对身体空间配置的内部模型。这个内部 表征对于感觉运动处理、运动控制和自我意识至关重要，并且 在移动过程中不断更新。当体感输入时，身体图式表征被打乱 已经迷失了。发现身体图式的神经关联的第一步是揭示 生成身体姿势表示。我们假设来自初级躯体感觉皮质的感觉输入 (S1)和次级躯体感觉皮质(S2)到后顶叶皮质(PPC)被转换为 构建一个身体姿势表示法。 为了描述身体姿势神经编码的潜在机制，这个项目将利用大型- 扩大监测规模，应用干预工具，开发新的数据分析工具，整合新的方法。我们的 方法是进行大规模电生理记录和新的3D姿势的无标记跟踪 在自由活动的老鼠身上。为了跟踪姿势，第一个目标是适应无标记跟踪流水线，该管道由一个 深度3D卷积神经网络用于处理来自多个 摄像机。第二个目标是对S1、S2和PPC中的神经元进行大规模记录，并使用高级 计算方法来确定哪些姿势特征最能解释这些脑区神经元的活动 皮质区域。最后，第三个目标是使用光遗传和投影特定的操作来解决 S1和S2本体感觉输入对PPC中姿势编码的因果影响。这项研究承诺 揭示感觉输入是如何参与生成身体图式表征和引导行为的。 我需要大量的培训来执行这个项目，并实现我获得终身教职的目标 教授职位。王凡博士实验室和公爵的严谨的方法论和智力环境 神经生物学社区将提高我的概念知识和技术技能。我将深入实施 通过培训和与专家合作学习技术。我将通过参加会议学习新的技术 神经像素和计算神经科学课程。最后，我将通过经常锻炼我的专业技能 参加研讨会、研讨会和与博士后指导委员会的会议。 拟议的项目将在杜克大学医学院的神经生物学系进行 校园里。杜克大学的这个跨学科社区将支持这方面的研究和培训 通过与有才华和协作的教职员工频繁互动，组织研讨会和 座谈会，大量练习研究演讲并获得宝贵反馈的机会，形成 个性化的博士后导师委员会，广泛的职业和专业培训，无价之宝 博士后协会的支持。

项目成果

Geometric deep learning enables 3D kinematic profiling across species and environments.

• DOI: 10.1038/s41592-021-01106-6
• 发表时间: 2021-05
• 期刊: Nature methods
• 影响因子: 48
• 作者: Dunn TW;Marshall JD;Severson KS;Aldarondo DE;Hildebrand DGC;Chettih SN;Wang WL;Gellis AJ;Carlson DE;Aronov D;Freiwald WA;Wang F;Ölveczky BP
• 通讯作者: Ölveczky BP