CPS: Medium: Collaborative Research: Towards optimal robot locomotion in fluids through physics-informed learning with distributed sensing

CPS：中：协作研究：通过分布式传感的物理信息学习实现流体中的最佳机器人运动

• 批准号: 1932130
• 负责人: Bo Cheng
• 金额: $ 55万
• 依托单位: Pennsylvania State Univ University Park
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1932130&HistoricalAwards=false
• 关键词: CPS; Medium; Collaborative; Research; Towards

Fishes are masters of locomotion in fluids owing to their highly integrated biological sensing, computing and motor systems. They are adept at collecting and exploiting rich information from the surrounding fluids for underwater sensing and locomotion control. Inspired and informed by fish swimming, this research aims to develop a novel bio-inspired cyber-physical system (CPS) that integrates the "physical" robot fish and fluid environment with the "cyber" robot control & machine learning algorithms. Specifically, this CPS system includes i) a pressure sensory skin with distributed sensing capability to collect flow information, ii) control and learning algorithms that compute robot motor signals, output by central pattern generators (CPGs) which receive pressure sensory feedback, iii) a robot fish platform to implement and validate the CPS framework for underwater sensing and control tasks, and iv) experimental and computational methods to investigate and model the underlying fluid physics. This CPS system will have immediate impacts on the core CPS research areas such as design, control, data analytics, autonomy, and real-time systems. It will also significantly impact a wide range of engineering applications which demand distributed sensing, control and adaptive actuation. Examples include human-machine interactions, medical robots, unmanned aerial/underwater vehicles, drug dosing, medical therapeutics, and space deployable structures among others. Leveraging the multidisciplinary nature of this research, this award will support a variety of educational and outreach activities. In particular, a list of activities in broadening participation in engineering will be carried out.This research project integrates multiple CPS technologies to develop bio-inspired technologies for swarm control of fish. These include innovation in sensing modality via a stretchable, pressure sensitive skin, physics inspired learning and swarm control. The project will first develop a distributed pressure sensitive synthetic skin, which will be installed on robotic fishes to map the pressure distribution on their body and caudal-fin surfaces. The distributed pressure information will then be used in a feedback control policy that modulates CPGs to produce caudal-fin motion patterns of the robotic fishes. The control policy and the caudal-fin motion patterns will be optimized via reinforcement learning first in a surrogate fluid environment and then in the true fluid environment. The surrogate fluid environment will be developed using data-driven non-parametric models informed by physics-based hydrodynamic models of fish swimming, trained using combined experimental and Computational Fluid Dynamics (CFD) simulation data. The above control-learning methods will also be used to achieve efficient schooling in a group of robotic fishes, individually controlled by a CPG, which interacts with each other through surrounding fluids and pressure sensory feedback. The optimized swimming/schooling performance of robotic fishes and the underlying physics will be studied using CFD simulation. Together, this research will advance CPS knowledge on: 1) the design and creation of electronic and sensor materials and devices for robot skin applications; 2) the development of data-efficient, physics-informed learning methods for robotic systems that operate in complex environments, especially leveraging the recent progress on deep learning to exploit the spatial and temporal richness of the pressure data for underwater sensing and robot control; and 3) the flow physics and modeling of fish swimming.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

鱼类是流体运动的大师，因为它们高度集成了生物传感、计算和运动系统。它们善于从周围的流体中收集和利用丰富的信息，用于水下传感和运动控制。受鱼类游泳的启发和启发，本研究旨在开发一种新型的仿生网络物理系统（CPS），该系统将“物理”机器鱼和流体环境与“网络”机器人控制和机器学习算法相结合。具体来说，该CPS系统包括i)一个具有分布式传感能力的压力传感皮肤，用于收集流量信息；ii)控制和学习算法，用于计算机器人电机信号，由接收压力传感反馈的中央模式发生器（cpg）输出；iii)一个机器鱼平台，用于实施和验证用于水下传感和控制任务的CPS框架。iv)实验和计算方法来研究和模拟潜在的流体物理。该CPS系统将对设计、控制、数据分析、自治和实时系统等核心CPS研究领域产生直接影响。它还将对需要分布式传感、控制和自适应驱动的广泛工程应用产生重大影响。例子包括人机交互、医疗机器人、无人机/水下航行器、药物给药、医疗疗法和空间可展开结构等。利用这项研究的多学科性质，该奖项将支持各种教育和推广活动。特别是，将进行一份扩大工程参与的活动清单。该研究项目整合了多种CPS技术，以开发生物启发技术来控制鱼群。其中包括通过可拉伸的压力敏感皮肤，物理启发学习和群体控制的传感方式的创新。该项目将首先开发一种分布式压力敏感合成皮肤，该皮肤将安装在机器鱼身上，以绘制其身体和尾鳍表面的压力分布。这些分布的压力信息将被用于反馈控制策略，该策略可以调节cpg来产生机器鱼的尾鳍运动模式。首先在替代流体环境中，然后在真实流体环境中，通过强化学习对控制策略和尾鳍运动模式进行优化。替代流体环境将使用数据驱动的非参数模型来开发，这些模型由基于物理的鱼类游泳流体动力学模型提供信息，并使用实验和计算流体动力学（CFD）模拟数据进行组合训练。上述控制学习方法也将用于实现一组机器鱼的有效学习，这些机器鱼由一个CPG单独控制，通过周围的流体和压力感官反馈相互作用。利用CFD模拟研究机器鱼的优化游泳/鱼群性能及其潜在的物理特性。总之，这项研究将推进CPS知识：1)机器人皮肤应用的电子和传感器材料和设备的设计和创造；2)为在复杂环境中运行的机器人系统开发数据高效、物理知识丰富的学习方法，特别是利用深度学习的最新进展，利用水下传感和机器人控制的压力数据的时空丰富性；3)鱼类游泳的流动物理与建模。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Effects of Design and Hydrodynamic Parameters on Optimized Swimming for Simulated, Fish-inspired Robots

设计和水动力参数对模拟鱼类机器人优化游泳的影响

• DOI: 10.1109/iros47612.2022.9981478
• 发表时间: 2022
• 期刊: IEEE
• 作者: Li, Donghao;Deng, Hankun;Bayiz, Yagiz E.;Cheng, Bo
• 通讯作者: Cheng, Bo

Deep Reinforcement Learning Control of a Boiling Water Reactor

沸水反应堆的深度强化学习控制

• DOI: 10.1109/tns.2022.3187662
• 发表时间: 2022
• 期刊: IEEE Transactions on Nuclear Science
• 影响因子: 1.8
• 作者: Chen, Xiangyi;Ray, Asok
• 通讯作者: Ray, Asok

Data Fusion and Pattern Classification in Dynamical Systems Via Symbolic Time Series Analysis

通过符号时间序列分析进行动态系统中的数据融合和模式分类

• DOI: 10.1115/1.4062830
• 发表时间: 2023
• 期刊: and Control
• 作者: Chen, Xiangyi;Ray, Asok
• 通讯作者: Ray, Asok

Development of an Autonomous Modular Swimming Robot with Disturbance Rejection and Path Tracking

• DOI: 10.1109/iros55552.2023.10341571
• 发表时间: 2023-10
• 期刊: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
• 作者: Hankun Deng;Colin Nitroy;Kundan Panta;Donghao Li;S. Priya;Bo Cheng

Effects of caudal fin stiffness on optimized forward swimming and turning maneuver in a robotic swimmer

• DOI: 10.1088/1748-3190/ad2f42
• 发表时间: 2024-05-01
• 期刊: BIOINSPIRATION & BIOMIMETICS
• 影响因子: 3.4
• 作者: Deng，Hankun;Li，Donghao;Cheng，Bo
• 通讯作者: Cheng，Bo