Math 2.0

Numerical analysis Basic notions and error analysis Concept

Round-off error

Summary

Round-off error, or rounding error, is the difference between the exact result of a computation and the result computed with rounded numbers. In floating-point arithmetic each single rounding has relative error at most the unit roundoff, about 10−1610^{-16} in double precision. Many roundings can add up, and a subtraction of nearly equal numbers can magnify them, as in catastrophic cancellation. It is distinct from truncation error, which comes from the method even in exact arithmetic.

Where this leads

4 pages build on this one.

Further reading

  1. Web https://en.wikipedia.org/wiki/Round-off_error
About this page
TagCPN6SD3BTV
URIm2://CPN6SD3BTV
Kindconcept
WritingW0 stub
MSC65G50
Same as

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

Used by

Results about this

Definitions