Optimal Control Theory for Time-Delay Systems

Optimal control theory for time-delay systems addresses the challenge of designing control laws when system dynamics depend explicitly on past states or inputs. Such delays arise in applications ranging from networked control and chemical processes to economic growth models and biological systems. The presence of delays renders the system infinite dimensional, complicating stability analysis, optimality conditions and numerical realisation. Extensions of the Pontryagin’s maximum principle incorporate adjoint equations with delayed arguments, while Lyapunov–Krasovskii functionals provide a framework for assessing stabilisation under uncertain or varying delay lengths. Numerical approaches frequently employ control parameterisation, time-scaling transformations or collocation methods to convert the original problem into a finite-dimensional optimisation. Predictor-based controllers compensate for known delays by forecasting future states, thereby enhancing performance. Recent advances emphasise robust formulations and efficient algorithms that ensure convergence despite non-smoothness or switching phenomena, enabling practical deployment in communications, manufacturing and resource management.

Research from Nature Portfolio

No recent Nature Portfolio content available.

Research from all publishers

Recent studies have refined computational strategies for handling multiple and endogenous delays in diverse settings. A novel method for switched systems with multiple time-delays reformulates the control design as a sequence of finite-dimensional programmes by parameterising piecewise-constant inputs, introducing smooth penalty functions for total variation and deriving explicit gradient expressions for fast convergence. In the context of data networks, an enhanced transmission control framework incorporates both control-dependent and discrete transmission delays into the Hamiltonian formalism, leading to a modified control parameterisation technique that yields clear insights into optimal transmission rates, queue sizes and latency effects under realistic buffering constraints. A foundational contribution in economic dynamics constructs exact optimal trajectories for models with endogenous delay durations by solving the delay-extended maximum principle, illustrating how delay length critically influences equipment replacement and investment strategies. Collectively, these works advance our understanding of stability, computational tractability and real-world applicability of optimal control under delay.

Optimal Control Theory for Time-Delay Systems publication trend

The graph below shows the total number of articles in optimal control theory for time-delay systems across all publications each year (not limited to Nature Index journals).

Technical terms

Time-delay system: A dynamical system in which the evolution of state variables depends explicitly on past values of states or controls, introducing memory effects and infinite-dimensional behaviour.

Pontryagin’s maximum principle: A set of necessary conditions for optimality that employs Hamiltonian functions and adjoint variables, extended to include arguments with delays.

Control parameterisation: A numerical technique in which control functions are approximated by a finite set of basis functions or piecewise-constant values, converting an infinite-dimensional problem into a tractable optimisation.

Lyapunov–Krasovskii functional: A generalisation of Lyapunov functions for systems with time delays, used to assess stability by accounting for the history of system trajectories.

Predictor-based control: A strategy that compensates for known time delays by forecasting future state trajectories using a system model, thereby improving performance and ensuring stabilisation.

References

1. Optimal control of switched systems with multiple time-delays and a cost on changing control. Journal of Industrial and Management Optimization (2018).
2. Optimal transmission of messages in computer networks – an optimal control problem involving control-dependent time-delayed arguments. Journal of Inequalities and Applications (2022).
3. Structure of optimal trajectories in a nonlinear dynamic model with endogenous delay. Journal of Applied Mathematics (2004).