Automatic design of interpretable control laws through parametrized Genetic Programming with adjoint state method gradient evaluation

Marchetti, Francesco; Pietropolli, Gloria; Verdù, Federico Julian Camerota; Castelli, Mauro; Minisci, Edmondo

http://hdl.handle.net/10362/166971

Utilize este identificador para referenciar este registo.

Nome:	Descrição:	Tamanho:	Formato:
Automatic_design_of_interpretable_control_laws_through_parametrized_Genetic_Programming_with_adjoint_state_method_gradient_evaluation.pdf		2.03 MB	Adobe PDF	Ver/Abrir

Contacte-nos

Autores

Marchetti, Francesco

Pietropolli, Gloria

Verdù, Federico Julian Camerota

Castelli, Mauro

Minisci, Edmondo

Resumo(s)

This work investigates the application of a Local Search (LS) enhanced Genetic Programming (GP) algorithm to the control scheme’s design task. The combination of LS and GP aims to produce an interpretable control law as similar as possible to the optimal control scheme reference. Inclusive Genetic Programming (IGP), a GP heuristic capable of promoting and maintaining the population diversity, is chosen as the GP algorithm since it proved successful on the considered task. IGP is enhanced with the Operators Gradient Descent (OPGD) approach, which consists of embedding learnable parameters into the GP individuals. These parameters are optimized during and after the evolutionary process. Moreover, the OPGD approach is combined with the adjoint state method to evaluate the gradient of the objective function. The original OPGD was formulated by relying on the backpropagation technique for the gradient’s evaluation, which is impractical in an optimization problem involving a dynamical system because of scalability and numerical errors. On the other hand, the adjoint method allows for overcoming this issue. Two experiments are formulated to test the proposed approach, named Operator Gradient Descent - Inclusive Genetic Programming (OPGD-IGP): the design of a Proportional-Derivative (PD) control law for a harmonic oscillator and the design of a Linear Quadratic Regulator (LQR) control law for an inverted pendulum on a cart. OPGD-IGP proved successful in both experiments, being capable of autonomously designing an interpretable control law similar to the optimal ones, both in terms of shape and control gains.

Descrição

Marchetti, F., Pietropolli, G., Verdù, F. J. C., Castelli, M., & Minisci, E. (2024). Automatic design of interpretable control laws through parametrized Genetic Programming with adjoint state method gradient evaluation. Applied Soft Computing, 159, 1-17. Article 111654. https://doi.org/10.1016/j.asoc.2024.111654 --- This work was supported by national funds through the FCT (Fundação para a Ciência e a Tecnologia) by the project UIDB/04152/2020-Centro de Investigação em Gestão de Informação – MagIC/NOVA IMS; and by the SPECIES Society through the SPECIES Scholarship 2022.