Rounding inflates exactly representable values at high precision

Float rounding epsilon now scales with precision to prevent inflating exact values.