Artificial neural networks trained through deep reinforcement learning discover control strategies for active flow control

作者：Jean Rabault, Miroslav Kuchta, Atle Jensen, Ulysse Réglade, Nicolas Cerardi · 发表于：Journal of Fluid Mechanics · 年份：2019 · DOI：10.1017/jfm.2019.62 · 被引用次数：574 · 研究领域：Model Reduction and Neural Networks、Fluid Dynamics and Turbulent Flows、Fluid Dynamics and Vibration Analysis

We present the first application of an artificial neural network trained through a deep reinforcement learning agent to perform active flow control. It is shown that, in a two-dimensional simulation of the Kármán vortex street at moderate Reynolds number ( $Re=100$ ), our artificial neural network is able to learn an active control strategy from experimenting with the mass flow rates of two jets on the sides of a cylinder. By interacting with the unsteady wake, the artificial neural network successfully stabilizes the vortex alley and reduces drag by approximately 8 %. This is performed while using small mass flow rates for the actuation, of the order of 0.5 % of the mass flow rate intersecting the cylinder cross-section once a new pseudo-periodic shedding regime is found. This opens the way to a new class of methods for performing active flow control.