Math 2.0

Numerical analysis Iterative methods for linear systems Theorem

Symmetric successive over-relaxation

Builds on System of linear equationsPositive definite matrixSpectral radiusSuccessive over-relaxationIterative methodPreconditioner

Statement

Let AA be a real symmetric n×nn \times n matrix with positive diagonal entries, and let b∈ℝnb \in \R^n. Write A=D+L+LTA = D + L + L^T, with DD diagonal and LL strictly lower triangular, and let 0<ω<20 < \omega < 2. One step of symmetric successive over-relaxation (SSOR) is a forward SOR sweep in the order 1,…,n1, \dots, n. It is followed by a backward SOR sweep in the order n,…,1n, \dots, 1. In matrix form it is x(k+1)=x(k)+Mω−1(b−Ax(k))x^{(k+1)} = x^{(k)} + M_\omega^{-1} \left( b - A x^{(k)} \right), where Mω=1ω(2−ω) (D+ωL) D−1 (D+ωLT).M_\omega = \frac{1}{\omega (2 - \omega)} \, (D + \omega L) \, D^{-1} \, (D + \omega L^T). Then MωM_\omega is symmetric and positive definite. If moreover AA is positive definite, then the iteration matrix I−Mω−1AI - M_\omega^{-1} A has spectral radius less than 11. So for every bb and every x(0)x^{(0)} the iterates converge to A−1bA^{-1} b.

Remarks

The matrix MωM_\omega is symmetric by its form, and it is positive definite because DD is and D+ωLD + \omega L is invertible. When AA is positive definite, each of the two SOR sweeps strictly decreases the energy norm ∥e∥A\norm{e}_A of the error, so their product contracts too. Example: for n=1n = 1 and A=(a)A = (a) with a>0a > 0, one has Mω=a/(ω(2−ω))M_\omega = a / (\omega (2 - \omega)). The iteration matrix is 1−ω(2−ω)=(1−ω)21 - \omega (2 - \omega) = (1 - \omega)^2, which lies in [0,1)[0, 1) exactly when 0<ω<20 < \omega < 2. As a stand-alone method, SSOR is usually no faster than SOR. Its value is that MωM_\omega is a symmetric positive definite preconditioner, so it can be combined with the conjugate gradient method, unlike plain SOR.

Going deeper

For a student

The formula for MωM_\omega shows that applying SSOR costs one forward and one backward triangular solve with the sparsity of AA. For ω=1\omega = 1 the method is symmetric Gauss–Seidel, with M1=(D+L)D−1(D+LT)M_1 = (D + L) D^{-1} (D + L^T). SSOR belongs to the family of stationary iterative methods given by a splitting A=Mω−(Mω−A)A = M_\omega - (M_\omega - A).

Reading path

To understand this page from the ground up, read these 11 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Diagonally dominant matrix concept
  2. Iterative method concept
  3. Matrix norm concept
  4. Positive definite matrix concept
  5. Preconditioner concept
  6. Spectral radius concept
  7. System of linear equations concept
  8. Jacobi method statement
  9. Gauss–Seidel method statement
  10. Successive over-relaxation statement
  11. Symmetric successive over-relaxation statement

Further reading

  1. Web https://en.wikipedia.org/wiki/Symmetric_successive_over-relaxation
About this page
TagY1G3NNJSQH
URIm2://Y1G3NNJSQH
Kindstatement, theorem
WritingW0 stub
MSC65F10, 65F08
StatusThis copy of the site has no build data. Run m2 status Y1G3NNJSQH.
AboutSuccessive over-relaxation, Preconditioner
UsesSystem of linear equations, Positive definite matrix, Spectral radius, Successive over-relaxation, Iterative method, Preconditioner
Same as

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.