Adaptive Neural Networks through Epigenetic Processes

通过表观遗传过程的自适应神经网络

• 批准号: 2435963
• 金额: --
• 依托单位: CARDIFF UNIVERSITY
• 依托单位国家: 英国
• 项目类别: Studentship
• 财政年份: 2020
• 资助国家: 英国
• 起止时间: 2020 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=studentship-2435963
• 关键词: Adaptive; Neural; Networks; through; Epigenetic

The recent increased availability of both data and computation has led to global interest in artificial neural networks - these have been shown to be highly effective in creating artificial intelligence particularly when functioning at scale (e.g., depth). Deploying neural networks typically involves training to establish appropriate weights between inputs and outputs. However such training is scenario dependent, with retraining needed if there is a significant change in the underlying environment. Therefore it is highly desirable for future neural networks to have the ability to self-adapt in relation to changes in their deployment scenario, so that flexibility is apparent and performance is maintained without full-scale retraining. This will become more important as AI engages with dynamic situations where neural networks may need to ideally learn and adapt with greater agility. In this project the aim is to take inspiration from genetic algorithms (GAs) for neural network self-adaptation. Longstanding work has demonstrated that GAs can successfully be used to evolve a high performance population of neural networks (e.g., Evolving Neural Networks through Augmenting Topologies - NEAT) while more recent work by Uber AI labs has demonstrated that genetic algorithms are a remarkably competitive alternative to training deep neural networks for reinforcement learning. The project will involve working in the relatively new field of epigenetic algorithms, and using these to promote adaptation of neural networks that are represented in a genetic form. Genetic processes inspire epigenetic algorithms, where the interaction with the environment influences the genes held by an individual between cycles of population reproduction. Epigenetics is a phenomenon that is now recognised in biology, pharmacology and medicine with many applications. The methodology will involve developing suitable representations, epigenetic techniques and evaluation methods to explore the problem of self-adaption in neural networks. This is an ambitious goal and this project will seek to establish fundamental steps in this area by assessing benchmarks that are well understood. This PhD is suitable for someone keen to gain in-depth knowledge of state-of-the-art deep learning and neuroevolution, and an interest in developing future AI with new and general capabilities. The project will be carried out in collaboration with IBM UK, Dstl, Cardiff University Crime and Security Institute and with international cooperation (University partners in the US via the Distributed Analytics and Information Sciences Distributed Technology Alliance).

最近数据和计算可用性的增加引起了全球对人工神经网络的兴趣——这些网络已被证明在创建人工智能方面非常有效，特别是在大规模（例如深度）运行时。部署神经网络通常涉及训练以在输入和输出之间建立适当的权重。然而，此类培训取决于场景，如果底层环境发生重大变化，则需要重新培训。因此，未来的神经网络非常需要能够根据部署场景的变化进行自适应，从而在无需全面重新训练的情况下实现明显的灵活性并保持性能。随着人工智能参与动态环境，神经网络可能需要更灵活地学习和适应，这一点将变得更加重要。该项目的目的是从遗传算法（GA）中获取神经网络自适应的灵感。长期的工作已经证明，遗传算法可以成功地用于进化高性能的神经网络群体（例如，通过增强拓扑进化神经网络 - NEAT），而 Uber AI 实验室最近的工作已经证明，遗传算法是训练深度神经网络进行强化学习的一种非常有竞争力的替代方案。该项目将涉及相对较新的表观遗传算法领域，并利用这些算法来促进以遗传形式表示的神经网络的适应。遗传过程激发了表观遗传算法，其中与环境的相互作用影响个体在种群繁殖周期之间持有的基因。表观遗传学是一种现已在生物学、药理学和医学领域得到认可的现象，具有许多应用。该方法将涉及开发合适的表示、表观遗传技术和评估方法，以探索神经网络的自适应问题。这是一个雄心勃勃的目标，该项目将通过评估众所周知的基准来寻求在该领域建立基本步骤。该博士学位适合那些热衷于深入了解最先进的深度学习和神经进化知识，并对开发具有新的通用功能的未来人工智能感兴趣的人。该项目将与 IBM UK、Dstl、卡迪夫大学犯罪与安全研究所以及国际合作伙伴（通过分布式分析和信息科学分布式技术联盟在美国的大学合作伙伴）合作开展。