Math 2.0

Calculus of variations and optimal control; optimization Definition

Riccati differential equation of optimal control

Builds on Symmetric matrixPositive semidefinite matrixPositive definite matrixRiccati equation

Definition

Let n,m≥1n, m \ge 1 and T>0T > 0. Let AA be a real n×nn \times n matrix and BB a real n×mn \times m matrix. Let QQ and FF be symmetric positive semidefinite n×nn \times n matrices, and let RR be a symmetric positive definite m×mm \times m matrix. The Riccati differential equation of the associated linear-quadratic problem is the terminal value problem −P′(t)=ATP(t)+P(t)A−P(t)BR−1BTP(t)+Q,P(T)=F,-P'(t) = A^{T} P(t) + P(t) A - P(t) B R^{-1} B^{T} P(t) + Q, \qquad P(T) = F, for a differentiable function P ⁣:(−∞,T]→ℝn×nP \colon (-\infty, T] \to \R^{n \times n} with symmetric values.

Remarks

Under these hypotheses the solution exists on all of (−∞,T](-\infty, T], and P(t)P(t) is symmetric positive semidefinite for every tt. Example: n=m=1n = m = 1, A=0A = 0, B=Q=R=1B = Q = R = 1 and F=0F = 0 give −P′=1−P2-P' = 1 - P^2, P(T)=0P(T) = 0. The solution is P(t)=tanh⁡(T−t)P(t) = \tanh(T - t): indeed P′(t)=−(1−tanh⁡2(T−t))=−(1−P(t)2)P'(t) = -(1 - \tanh^2(T - t)) = -(1 - P(t)^2) and P(T)=0P(T) = 0. As t→−∞t \to -\infty, P(t)→1P(t) \to 1, the positive solution of the algebraic equation 1−P2=01 - P^2 = 0. Non-example: the linear equation −P′=ATP+PA+Q-P' = A^{T} P + P A + Q is a Lyapunov differential equation, not a Riccati equation, since it lacks the quadratic term. It gives the cost of the zero control; with A−BKA - BK in place of AA and Q+KTRKQ + K^{T} R K in place of QQ it gives the cost of a fixed linear feedback u=−Kxu = -Kx. The quadratic term of the Riccati equation accounts for optimizing the control. For n=1n = 1 the equation is a scalar Riccati equation P′=q0+q1P+q2P2P' = q_0 + q_1 P + q_2 P^2 with constant coefficients.

Reading path

To understand this page from the ground up, read these 5 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Positive definite matrix concept
  2. Positive semidefinite matrix concept
  3. Riccati equation concept
  4. Symmetric matrix concept
  5. Riccati differential equation of optimal control definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Riccati_equation
About this page
TagFV1E09CJQN
URIm2://FV1E09CJQN
Kinddefinition
WritingW0 stub
MSC49N10, 34A34, 93C05
DefinesRiccati differential equation of optimal control
UsesSymmetric matrix, Positive semidefinite matrix, Positive definite matrix, Riccati equation

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.