Category:Definitions/Calculation Rounding Errors

This category contains definitions related to Calculation Rounding Errors.
Related results can be found in Category:Calculation Rounding Errors.

Let $S$ be a set of continuous data.

Let $\map C S$ be a calculation which is to be made on $S$.

The calculation rounding error of $S$ is defined as:

$R = \size {\map C S - \overline {\map C {\overline S} } }$

where:

$\overline x$ denotes the rounded value of a given $x$

$\size {\, \cdot \,}$ denotes the absolute value function.