Math 2.0

Numerical analysis Iterative methods for linear systems Theorem

Multigrid method

Builds on Invertible matrixMatrix normJacobi methodGauss–Seidel methodElliptic partial differential equationFinite difference methodIterative methodPreconditionerConjugate gradient method

Statement

Let AhA_h be an invertible real n×nn \times n matrix (the fine-grid matrix) and AHA_H an invertible real N×NN \times N matrix with N<nN < n (the coarse-grid matrix). Let PP be an n×Nn \times N matrix (prolongation) and RR an N×nN \times n matrix (restriction). Let WW be an invertible n×nn \times n matrix, and let S=I−W−1AhS = I - W^{-1} A_h be the iteration matrix of the smoother x↦x+W−1(b−Ahx)x \mapsto x + W^{-1}(b - A_h x). One step of the two-grid method for Ahx=bA_h x = b applies ν≥1\nu \ge 1 smoothing steps to xx and then the coarse-grid correction x↦x+PAH−1R(b−Ahx)x \mapsto x + P A_H^{-1} R (b - A_h x).

  1. The error e=x−Ah−1be = x - A_h^{-1} b is mapped to MeM e, where M=(I−PAH−1RAh)SνM = (I - P A_H^{-1} R A_h) S^{\nu}.
  2. (Hackbusch) Let ∥⋅∥\norm{\cdot} be an operator norm, and let C>0C > 0 and η(ν)≥0\eta(\nu) \ge 0 be numbers with ∥Ah−1−PAH−1R∥≤C/∥Ah∥\norm{A_h^{-1} - P A_H^{-1} R} \le C / \norm{A_h} (approximation property) and ∥AhSν∥≤η(ν)∥Ah∥\norm{A_h S^{\nu}} \le \eta(\nu) \norm{A_h} (smoothing property). Then ∥M∥≤C η(ν)\norm{M} \le C \, \eta(\nu).

Remarks

Clause 1 follows by composing the error maps e↦See \mapsto S e of the smoother and e↦(I−PAH−1RAh)ee \mapsto (I - P A_H^{-1} R A_h) e of the correction. Clause 2 follows from the factorization M=(Ah−1−PAH−1R) AhSνM = (A_h^{-1} - P A_H^{-1} R) \, A_h S^{\nu} and the two bounds. Consider a family of finite difference or finite element discretizations of an elliptic equation, with mesh widths hh and H=2hH = 2h. Use damped Jacobi smoothing and standard transfer matrices. Under elliptic regularity assumptions, both properties hold with CC and η\eta independent of hh, and η(ν)→0\eta(\nu) \to 0. Then for ν\nu large enough the two-grid method contracts the error by a factor less than 11 that does not depend on hh. Example: for AhA_h symmetric positive definite and S=I−Ah/∥Ah∥2S = I - A_h / \norm{A_h}_2 in the matrix norm ∥⋅∥2\norm{\cdot}_2, one has ∥AhSν∥2≤max⁡0≤t≤1t(1−t)ν∥Ah∥2≤∥Ah∥2/(ν+1)\norm{A_h S^\nu}_2 \le \max_{0 \le t \le 1} t (1 - t)^\nu \norm{A_h}_2 \le \norm{A_h}_2 / (\nu + 1). Solving the coarse problem recursively by the same method gives the V-cycle and the W-cycle.

Going deeper

For a student

For elliptic problems, multigrid reaches a fixed accuracy in O(n)O(n) operations, which is optimal up to a constant. The analysis splits into the smoothing property, a statement about the smoother alone, and the approximation property, a statement about the discretizations on the two grids. Algebraic multigrid builds the coarse levels from the matrix alone, without a geometric grid. Multigrid is also used as a preconditioner for the conjugate gradient method, and it is among the fastest iterative methods for such problems.

Reading path

To understand this page from the ground up, read these 21 pages in order. The foundations come first.

Show the path as a graph
Chebyshev polynomials, object, no evidence levelChebyshev polynomialsobjectCondition number, concept, no evidence levelCondition numberconceptDiagonally dominant matrix, concept, no evidence levelDiagonally dominant m…conceptEigenvalue, concept, no evidence levelEigenvalueconceptElliptic partial differential equation, concept, no evidence levelElliptic partial diff…conceptFinite difference method, concept, no evidence levelFinite difference met…conceptIncomplete Cholesky factorization, concept, no evidence levelIncomplete Cholesky f…conceptInvertible matrix, concept, no evidence levelInvertible matrixconceptIterative method, concept, no evidence levelIterative methodconceptKrylov subspace, concept, no evidence levelKrylov subspaceconceptMatrix norm, concept, no evidence levelMatrix normconceptPositive definite matrix, concept, no evidence levelPositive definite mat…conceptPreconditioner, concept, no evidence levelPreconditionerconceptSpectral radius, concept, no evidence levelSpectral radiusconceptSystem of linear equations, concept, no evidence levelSystem of linear equa…conceptModified Richardson iteration, statement, no evidence levelModified Richardson i…statementJacobi method, statement, no evidence levelJacobi methodstatementChebyshev iteration, statement, no evidence levelChebyshev iterationstatementGauss–Seidel method, statement, no evidence levelGauss–Seidel methodstatementConjugate gradient method, statement, no evidence levelConjugate gradient me…statementMultigrid method, statement, no evidence levelMultigrid methodstatement
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Chebyshev polynomials object
  2. Condition number concept
  3. Diagonally dominant matrix concept
  4. Eigenvalue concept
  5. Elliptic partial differential equation concept
  6. Finite difference method concept
  7. Incomplete Cholesky factorization concept
  8. Invertible matrix concept
  9. Iterative method concept
  10. Krylov subspace concept
  11. Matrix norm concept
  12. Positive definite matrix concept
  13. Preconditioner concept
  14. Spectral radius concept
  15. System of linear equations concept
  16. Modified Richardson iteration statement
  17. Jacobi method statement
  18. Chebyshev iteration statement
  19. Gauss–Seidel method statement
  20. Conjugate gradient method statement
  21. Multigrid method statement

Further reading

  1. Web https://en.wikipedia.org/wiki/Multigrid_method
About this page
TagAC9PY6FBYF
URIm2://AC9PY6FBYF
Kindstatement, theorem
WritingW0 stub
MSC65N55, 65F10, 65N22
StatusThis copy of the site has no build data. Run m2 status AC9PY6FBYF.
AboutIterative method
UsesInvertible matrix, Matrix norm, Jacobi method, Gauss–Seidel method, Elliptic partial differential equation, Finite difference method, Iterative method, Preconditioner, Conjugate gradient method
Same as

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.