A Comparison of Mesh-Free Differentiable Programming and Data-Driven Strategies for Optimal Control under PDE Constraints

Ngueguin, Roussel Desmond Nzoyem and Barton, David A.W. and Deakin, Tom

Fourth Workshop on Artificial Intelligence and Machine Learning for Scientific Applications help in conjunction with Supercomputing (AI4S), 2023

Abstract

The field of Optimal Control under Partial Differential Equations (PDE) constraints is rapidly changing under the influence of Deep Learning and the accompanying automatic differentiation libraries. Novel techniques like Physics-Informed Neural Networks (PINNs) and Differentiable Programming (DP) are to be contrasted with established numerical schemes like Direct-Adjoint Looping (DAL). We present a comprehensive comparison of DAL, PINN, and DP using a general-purpose mesh-free differentiable PDE solver based on Radial Basis Functions. Under Laplace and Navier-Stokes equations, we found DP to be extremely effective as it produces the most accurate gradients; thriving even when DAL fails and PINNs struggle. Additionally, we provide a detailed benchmark highlighting the limited conditions under which any of those methods can be efficiently used. Our work provides a guide to Optimal Control practitioners and connects them further to the Deep Learning community.

In press

@inproceedings{ai4s23,
  author = {Ngueguin, Roussel Desmond Nzoyem and Barton, David A.W. and Deakin, Tom},
  title = {{A Comparison of Mesh-Free Differentiable Programming and Data-Driven Strategies for Optimal Control under PDE Constraints}},
  booktitle = {{Fourth Workshop on Artificial Intelligence and Machine Learning for Scientific Applications help in conjunction with Supercomputing (AI4S)}},
  year = {2023},
  publisher = {{IEEE}},
  keywords = {Conferences and Workshops},
  doi = {10.1145/3624062.3626078},
  url = {https://arxiv.org/abs/2310.02286},
  note = {In press}
}