Appendix B - Noise and Resolution Tables

The following tables provide typical noise levels of the U6 under ideal conditions. The resulting voltage resolution is then calculated based on the noise levels.

Measurements were taken with AIN0 connected to GND with a short jumper wire, or from internal ground channel #15.

All “counts” data are aligned as 24-bit values. To equate to counts at a particular resolution (Res) use the formula counts/(2^(24-Res)). For instance, with the U6 set to resolution=1 and the ±10 volt range, there are 1024 counts of noise when looking at 24-bit values. To equate this to 16-bit data, we take 1024/(2^8) which equals 4 counts of noise when looking at 16-bit values.

Noise-free data is determined by taking 128 readings and subtracting the minimum value from the maximum value.

RMS and Effective data are determined from the standard deviation of 128 readings. In other words, the RMS data represents most readings, whereas noise-free data represents all readings.