First page Back Continue Last page Overview Graphics
Round-off Error, Cont'd
Subtraction of two very nearly equal numbers can give rise to large RE.
- e.g. Solution of quadratic equation...
-
-
- ...can go badly wrong whenever ac << b2 (Cf. PS#2).
RE cannot be avoidedit is a consequence of using a finite number of bits to represent real values.
Notes: