A Comprehensive Evaluation of Generalizability of Deep Learning-Based Hi-C Resolution Improvement Methods.
A Comprehensive Evaluation of Generalizability of Deep Learning-Based Hi-C Resolution Improvement Methods.
复制标题
作者:
Hi-C is a widely used technique to study the 3D organization of the genome. Due to its high sequencing cost, most of the generated datasets are of a coarse resolution, which makes it impractical to study finer chromatin features such as Topologically Associating Domains (TADs) and chromatin loops. Multiple deep learning-based methods have recently been proposed to increase the resolution of these datasets by imputing Hi-C reads (typically called upscaling). However, the existing works evaluate these methods on either synthetically downsampled datasets, or a small subset of experimentally generated sparse Hi-C datasets, making it hard to establish their generalizability in the real-world use case. We present our framework—Hi-CY—that compares existing Hi-C resolution upscaling methods on seven experimentally generated low-resolution Hi-C datasets belonging to various levels of read sparsities originating from three cell lines on a comprehensive set of evaluation metrics. Hi-CY also includes four downstream analysis tasks, such as TAD and chromatin loops recall, to provide a thorough report on the generalizability of these methods. We observe that existing deep learning methods fail to generalize to experimentally generated sparse Hi-C datasets, showing a performance reduction of up to 57%. As a potential solution, we find that retraining deep learning-based methods with experimentally generated Hi-C datasets improves performance by up to 31%. More importantly, Hi-CY shows that even with retraining, the existing deep learning-based methods struggle to recover biological features such as chromatin loops and TADs when provided with sparse Hi-C datasets. Our study, through the Hi-CY framework, highlights the need for rigorous evaluation in the future. We identify specific avenues for improvements in the current deep learning-based Hi-C upscaling methods, including but not limited to using experimentally generated datasets for training.
登录
查看更多内容
影响因子:
64.8
作者:
Jin, Fulai;Li, Yan;Dixon, Jesse R.;Selvaraj, Siddarth;Ye, Zhen;Lee, Ah Young;Yen, Chia-An;Schmitt, Anthony D.;Espinoza, Celso A.;Ren, Bing
通讯作者:
Ren, Bing
影响因子:
4.4
作者:
Oluwadare O;Zhang Y;Cheng J
通讯作者:
Cheng J
影响因子:
16.6
作者:
Zhang Y;An L;Xu J;Zhang B;Zheng WJ;Hu M;Tang J;Yue F
通讯作者:
Yue F
影响因子:
4.3
作者:
Hong, Hao;Jiang, Shuai;Bo, Xiaochen
通讯作者:
Bo, Xiaochen
DOI:
10.1073/pnas.1911708117
发表时间:
2020-01-28
影响因子:
11.1
作者:
Pugacheva, Elena M.;Kubo, Naoki;Lobanenkov, Victor V.
通讯作者:
Lobanenkov, Victor V.