Systems theory; control Feedback design for linear systems Theorem
Separation principle
Builds on Linear-quadratic-Gaussian controlLinear-quadratic regulatorRiccati differential equation of optimal controlConditional expectation
Statement
Consider the linear-quadratic-Gaussian control problem on with matrices , noise covariances and , and initial mean and covariance . Let solve the Riccati differential equation with . Let solve the filter Riccati equation with . Let be the Kalman–Bucy filter, the solution of Then the control is admissible and optimal among all admissible controls. Here is the conditional expectation of given the observations , .
Remarks
The proof has two parts. First, for every admissible control, the error is a Gaussian process whose law does not depend on , with covariance . Second, writing splits the cost into a term that does not depend on and the cost of a fully observed linear-quadratic problem for . The linear-quadratic regulator then gives the optimal feedback for . The gain is the same as without noise, and the filter gain does not depend on the cost: estimation and control separate. A deterministic version holds for observer-based feedback of , . With the observer and , the error solves . In the coordinates the closed-loop matrix is block triangular, so its eigenvalues are those of together with those of . The principle depends on linear dynamics, Gaussian noise and quadratic cost; for nonlinear problems the best control may need to act so as to improve future estimates.
Going deeper
For a student
The estimator is the Kalman–Bucy filter and the controller is the linear-quadratic regulator gain, and each comes from its own Riccati equation. The two Riccati equations are dual: the filter equation is the control equation for run forward in time. In practice this lets engineers design the estimator and the controller separately. The deterministic version is the reason why pole placement for the controller and for the observer can be done independently.
Reading path
To understand this page from the ground up, read these 13 pages in order. The foundations come first.
Show the path as a graph
- no evidence level
- Algebraic Riccati equation concept
- Conditional expectation concept
- Expected value concept
- Filtration concept
- Optimal control concept
- Positive definite matrix concept
- Positive semidefinite matrix concept
- Riccati differential equation of optimal control concept
- Stochastic differential equation concept
- Wiener process concept
- Linear-quadratic regulator problem
- Linear-quadratic-Gaussian control problem
- Separation principle statement
Further reading
About this page
| Tag | TMEKPXMC7V |
|---|---|
| URI | m2://TMEKPXMC7V |
| Kind | statement, theorem |
| Writing | W0 stub |
| MSC | 93E20, 49N10, 93E11 |
| Status | This copy of the site has no build data. Run m2 status TMEKPXMC7V. |
| About | Linear-quadratic-Gaussian control |
| Uses | Linear-quadratic-Gaussian control, Linear-quadratic regulator, Riccati differential equation of optimal control, Conditional expectation |
| Same as |
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
- a source with a locator (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.