Machine learning strategies for path-planning microswimmers in turbulent flows
Abstract
We develop an adversarial-reinforcement learning scheme for microswimmers in statistically homogeneous and isotropic turbulent fluid flows, in both two and three dimensions. We show that this scheme allows microswimmers to find nontrivial paths, which enable them to reach a target on average in less time than a naïve microswimmer, which tries, at any instant of time and at a given position in space, to swim in the direction of the target. We use pseudospectral direct numerical simulations of the two- and three-dimensional (incompressible) Navier-Stokes equations to obtain the turbulent flows. We then introduce passive microswimmers that try to swim along a given direction in these flows; the microswimmers do not affect the flow, but they are advected by it. Two nondimensional control parameters play important roles in our learning scheme: (a) the ratio V∼s of the microswimmer's bare velocity Vs and the root-mean-square (rms) velocity urms of the turbulent fluid and (b) the product B ∼ of the microswimmer-response time B and the rms vorticity ωrms of the fluid. We show that the average time required for the microswimmers to reach the target, by using our adversarial-reinforcement learning scheme, eventually reduces below the average time taken by microswimmers that follow the naïve strategy.
- Publication:
-
Physical Review E
- Pub Date:
- April 2020
- DOI:
- 10.1103/PhysRevE.101.043110
- arXiv:
- arXiv:1910.01728
- Bibcode:
- 2020PhRvE.101d3110A
- Keywords:
-
- Physics - Fluid Dynamics;
- Mathematics - Optimization and Control;
- Statistics - Machine Learning
- E-Print:
- 8 pages, 10 figures