Math 2.0

Systems theory; control Feedback design for linear systems Theorem

Separation principle

Builds on Linear-quadratic-Gaussian controlLinear-quadratic regulatorRiccati differential equation of optimal controlConditional expectation

Statement

Consider the linear-quadratic-Gaussian control problem on [0,T][0, T] with matrices A,B,C,Q,R,FA, B, C, Q, R, F, noise covariances Ξ\Xi and Θ\Theta, and initial mean m0m_0 and covariance Σ0\Sigma_0. Let PP solve the Riccati differential equation −P′=ATP+PA−PBR−1BTP+Q-P' = A^{T} P + P A - P B R^{-1} B^{T} P + Q with P(T)=FP(T) = F. Let Σ\Sigma solve the filter Riccati equation Σ′=AΣ+ΣAT+Ξ−ΣCTΘ−1CΣ\Sigma' = A \Sigma + \Sigma A^{T} + \Xi - \Sigma C^{T} \Theta^{-1} C \Sigma with Σ(0)=Σ0\Sigma(0) = \Sigma_0. Let x^\hat{x} be the Kalman–Bucy filter, the solution of dx^=(Ax^+Bu) dt+ΣCTΘ−1(dy−Cx^ dt),x^(0)=m0.d\hat{x} = (A \hat{x} + B u) \, dt + \Sigma C^{T} \Theta^{-1} (dy - C \hat{x} \, dt), \qquad \hat{x}(0) = m_0. Then the control u∗(t)=−R−1BTP(t)x^(t)u^*(t) = -R^{-1} B^{T} P(t) \hat{x}(t) is admissible and optimal among all admissible controls. Here x^(t)\hat{x}(t) is the conditional expectation of x(t)x(t) given the observations y(s)y(s), s≤ts \le t.

Remarks

The proof has two parts. First, for every admissible control, the error x−x^x - \hat{x} is a Gaussian process whose law does not depend on uu, with covariance Σ(t)\Sigma(t). Second, writing x=x^+(x−x^)x = \hat{x} + (x - \hat{x}) splits the cost into a term that does not depend on uu and the cost of a fully observed linear-quadratic problem for x^\hat{x}. The linear-quadratic regulator then gives the optimal feedback for x^\hat{x}. The gain R−1BTPR^{-1} B^{T} P is the same as without noise, and the filter gain ΣCTΘ−1\Sigma C^{T} \Theta^{-1} does not depend on the cost: estimation and control separate. A deterministic version holds for observer-based feedback of x′=Ax+Bux' = A x + B u, y=Cxy = C x. With the observer x^′=Ax^+Bu+L(y−Cx^)\hat{x}' = A \hat{x} + B u + L(y - C \hat{x}) and u=−Kx^u = -K \hat{x}, the error e=x−x^e = x - \hat{x} solves e′=(A−LC)ee' = (A - L C) e. In the coordinates (x,e)(x, e) the closed-loop matrix is block triangular, so its eigenvalues are those of A−BKA - B K together with those of A−LCA - L C. The principle depends on linear dynamics, Gaussian noise and quadratic cost; for nonlinear problems the best control may need to act so as to improve future estimates.

Going deeper

For a student

The estimator is the Kalman–Bucy filter and the controller is the linear-quadratic regulator gain, and each comes from its own Riccati equation. The two Riccati equations are dual: the filter equation is the control equation for (AT,CT)(A^{T}, C^{T}) run forward in time. In practice this lets engineers design the estimator and the controller separately. The deterministic version is the reason why pole placement for the controller and for the observer can be done independently.

Reading path

To understand this page from the ground up, read these 13 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Algebraic Riccati equation concept
  2. Conditional expectation concept
  3. Expected value concept
  4. Filtration concept
  5. Optimal control concept
  6. Positive definite matrix concept
  7. Positive semidefinite matrix concept
  8. Riccati differential equation of optimal control concept
  9. Stochastic differential equation concept
  10. Wiener process concept
  11. Linear-quadratic regulator problem
  12. Linear-quadratic-Gaussian control problem
  13. Separation principle statement

Further reading

  1. Web https://en.wikipedia.org/wiki/Separation_principle
About this page
TagTMEKPXMC7V
URIm2://TMEKPXMC7V
Kindstatement, theorem
WritingW0 stub
MSC93E20, 49N10, 93E11
StatusThis copy of the site has no build data. Run m2 status TMEKPXMC7V.
AboutLinear-quadratic-Gaussian control
UsesLinear-quadratic-Gaussian control, Linear-quadratic regulator, Riccati differential equation of optimal control, Conditional expectation
Same as

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.