Developing novel deep-learning based methods for deciphering non-coding gene regulatory code

开发基于深度学习的新型方法来破译非编码基因调控密码

基本信息

项目摘要

SUMMARY This project will contribute novel pre-trained DNA Bidirectional Encoder Representations from Transformers, called DNABERT, and associated deep-learning tools to decipher the language of non-coding DNA and facilitate integration of gene regulatory information from rapidly accumulating sequence data with NLM’s genetic databases (for example, dbSNP, dbGaP and ClinVar), which serve both scientists and the public health by helping identify the genetic components of disease. While the genetic code explaining how DNA is translated into proteins is universal, the regulatory code that determines when and how the genes are expressed varies across different cell-types and organisms. Non-coding DNA is highly complex due to the existence of polysemy and distant semantic relationship, from a language modeling perspective. Recently, deep learning methods have been used in unraveling the gene regulatory code, but failed to globally and robustly model such language features in the genome, especially in data-scarce scenarios. To address this challenge, we propose DNABERT to model DNA as a language, by adapting the idea of Bidirectional Encoder Representations from Transformers (BERT). Based on recent observations in natural language processing research, we hypothesize that pre-trained transformer-based neural network model offer a promising, and yet not fully explored, deep learning approach for a variety of sequence prediction tasks in the analysis of non-coding DNA. Our preliminary results showed that DNABERT on the human genome achieved state-of-the-art performance on promoter and splice-site prediction tasks, after easy fine-tuning on small task-specific data (Ji, Y. et al. 2020). The goal of our proposed research is to develop DNABERT for a variety of sequence prediction tasks, and benchmark with existing state- of-the-art deep-learning based methods. Specific aims are (1) develop novel deep-learning methods by adapting BERT; (2) apply the proposed deep-learning methods to specifically target non-coding DNA sequence analyses and predictions; and (3) predict and validate functional non-coding genetic variants by applying DNABERT prediction models. A major contribution of the proposed research is development of pre-trained DNABERT model and prediction algorithms, which present new powerful methods for analyses and predictions of DNA sequences. Since the pre-training of DNABERT is resource-intensive, we will provide the source code and pre-trained model at Github for future academic research. We will also develop an integrated web server to (1) deploy DNABERT model, (2) database to store the identified sequence features and predictions, and (3) tutorials to help users to apply DNABERT to their specific research problems. We anticipate that DNABERT can bring new advancements and insights to the bioinformatics community by bringing advanced language modeling perspective to gene regulation analyses.
总结

项目成果

期刊论文数量(5)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
DNABERT-S: LEARNING SPECIES-AWARE DNA EMBEDDING WITH GENOME FOUNDATION MODELS
  • DOI:
    10.48550/arxiv.2402.08777
  • 发表时间:
    2024-02
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Zhihan Zhou;Weimin Wu;Harrison Ho;Jiayi Wang;Lizhen Shi;R. Davuluri;Zhong Wang;Han Liu
  • 通讯作者:
    Zhihan Zhou;Weimin Wu;Harrison Ho;Jiayi Wang;Lizhen Shi;R. Davuluri;Zhong Wang;Han Liu
Deep multi-omics integration by learning correlation-maximizing representation identifies prognostically stratified cancer subtypes.
  • DOI:
    10.1093/bioadv/vbad075
  • 发表时间:
    2023
  • 期刊:
  • 影响因子:
    0
  • 作者:
    Ji, Yanrong;Dutta, Pratik;Davuluri, Ramana
  • 通讯作者:
    Davuluri, Ramana
Personizing the prediction of future susceptibility to a specific disease.
  • DOI:
    10.1371/journal.pone.0243127
  • 发表时间:
    2021
  • 期刊:
  • 影响因子:
    3.7
  • 作者:
    Taha K;Davuluri R;Yoo P;Spencer J
  • 通讯作者:
    Spencer J
{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

数据更新时间:{{ journalArticles.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ monograph.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ sciAawards.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ conferencePapers.updateTime }}

{{ item.title }}
  • 作者:
    {{ item.author }}

数据更新时间:{{ patent.updateTime }}

RAMANA V DAVULURI其他文献

RAMANA V DAVULURI的其他文献

{{ item.title }}
{{ item.translation_title }}
  • DOI:
    {{ item.doi }}
  • 发表时间:
    {{ item.publish_year }}
  • 期刊:
  • 影响因子:
    {{ item.factor }}
  • 作者:
    {{ item.authors }}
  • 通讯作者:
    {{ item.author }}

{{ truncateString('RAMANA V DAVULURI', 18)}}的其他基金

Developing novel deep-learning based methods for deciphering non-coding gene regulatory code
开发基于深度学习的新型方法来破译非编码基因调控密码
  • 批准号:
    10451673
  • 财政年份:
    2021
  • 资助金额:
    $ 33.08万
  • 项目类别:
Informatics Platform for Mammalian Gene Regulation at Isoform-level
异构体水平的哺乳动物基因调控信息学平台
  • 批准号:
    10273985
  • 财政年份:
    2020
  • 资助金额:
    $ 33.08万
  • 项目类别:
Informatics Platform for Mammalian Gene Regulation at Isoform-level
异构体水平的哺乳动物基因调控信息学平台
  • 批准号:
    9922347
  • 财政年份:
    2013
  • 资助金额:
    $ 33.08万
  • 项目类别:
Informatics Platform for Mammalian Gene Regulation at Isoform-level
异构体水平的哺乳动物基因调控信息学平台
  • 批准号:
    8843951
  • 财政年份:
    2013
  • 资助金额:
    $ 33.08万
  • 项目类别:
Informatics platform for mammalian gene regulation at isoform-level
异构体水平的哺乳动物基因调控信息学平台
  • 批准号:
    8658144
  • 财政年份:
    2013
  • 资助金额:
    $ 33.08万
  • 项目类别:
Bioinformatics Facility
生物信息学设施
  • 批准号:
    7945001
  • 财政年份:
    2009
  • 资助金额:
    $ 33.08万
  • 项目类别:
Genomewide discovery & analysis of alternative promoters
全基因组发现
  • 批准号:
    7678211
  • 财政年份:
    2006
  • 资助金额:
    $ 33.08万
  • 项目类别:
Genomewide discovery & analysis of alternative promoters
全基因组发现
  • 批准号:
    7226994
  • 财政年份:
    2006
  • 资助金额:
    $ 33.08万
  • 项目类别:
Genomewide discovery & analysis of alternative promoters
全基因组发现
  • 批准号:
    7371108
  • 财政年份:
    2006
  • 资助金额:
    $ 33.08万
  • 项目类别:
Genomewide discovery & analysis of alternative promoters
全基因组发现
  • 批准号:
    7033451
  • 财政年份:
    2006
  • 资助金额:
    $ 33.08万
  • 项目类别:

相似国自然基金

企业绩效评价的DEA-Benchmarking方法及动态博弈研究
  • 批准号:
    70571028
  • 批准年份:
    2005
  • 资助金额:
    16.5 万元
  • 项目类别:
    面上项目

相似海外基金

An innovative EDI data, insights & peer benchmarking platform enabling global business leaders to build data-led EDI strategies, plans and budgets.
创新的 EDI 数据、见解
  • 批准号:
    10100319
  • 财政年份:
    2024
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Collaborative R&D
BioSynth Trust: Developing understanding and confidence in flow cytometry benchmarking synthetic datasets to improve clinical and cell therapy diagnos
BioSynth Trust:发展对流式细胞仪基准合成数据集的理解和信心,以改善临床和细胞治疗诊断
  • 批准号:
    2796588
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Studentship
Collaborative Research: SHF: Medium: A Comprehensive Modeling Framework for Cross-Layer Benchmarking of In-Memory Computing Fabrics: From Devices to Applications
协作研究:SHF:Medium:内存计算结构跨层基准测试的综合建模框架:从设备到应用程序
  • 批准号:
    2347024
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Standard Grant
Elements: CausalBench: A Cyberinfrastructure for Causal-Learning Benchmarking for Efficacy, Reproducibility, and Scientific Collaboration
要素:CausalBench:用于因果学习基准测试的网络基础设施,以实现有效性、可重复性和科学协作
  • 批准号:
    2311716
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Standard Grant
Benchmarking collisional rates and hot electron transport in high-intensity laser-matter interaction
高强度激光-物质相互作用中碰撞率和热电子传输的基准测试
  • 批准号:
    2892813
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Studentship
Collaborative Research: BeeHive: A Cross-Problem Benchmarking Framework for Network Biology
合作研究:BeeHive:网络生物学的跨问题基准框架
  • 批准号:
    2233969
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Continuing Grant
FET: Medium: Quantum Algorithms, Complexity, Testing and Benchmarking
FET:中:量子算法、复杂性、测试和基准测试
  • 批准号:
    2311733
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Continuing Grant
Establishing and benchmarking advanced methods to comprehensively characterize somatic genome variation in single human cells
建立先进方法并对其进行基准测试,以全面表征单个人类细胞的体细胞基因组变异
  • 批准号:
    10662975
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
Collaborative Research: BeeHive: A Cross-Problem Benchmarking Framework for Network Biology
合作研究:BeeHive:网络生物学的跨问题基准框架
  • 批准号:
    2233968
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Continuing Grant
Benchmarking Quantum Advantage
量子优势基准测试
  • 批准号:
    EP/Y004418/1
  • 财政年份:
    2023
  • 资助金额:
    $ 33.08万
  • 项目类别:
    Research Grant
{{ showInfoDetail.title }}

作者:{{ showInfoDetail.author }}

知道了