|[home] [lexicon] [problems] [tests] [courses] [auxiliaries] [notes] [staff]|
|A B C D E F G H I J K L M N O P Q R S T U V W X Y Z||overview|
Standard rounding approximates a real number with the nearest even floating point number R. If lies within the admissible floating point range, then
where is the base and the number of digits of the floating point representation. The constant eps is called the machine precision and equals
for double precision.
|automatically generated 3/ 8/2007|