[home] [lexicon] [problems] [tests] [courses] [auxiliaries] [notes] [staff] | ||

Mathematics-Online lexicon: | ||

## Rounding |

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z | overview |

Standard rounding approximates a real number with the nearest even floating point number R. If lies within the admissible floating point range, then

R eps

where is the base and the number of digits of the floating point representation. The constant eps is called the machine precision and equals

for double precision.

**Annotation:**

automatically generated 3/ 8/2007 |