Concept

Noise floor — where it appears

The level below which a circuit's output stops being a scaled copy of its input, and which gain raises along with the signal. It bounds a model from below where every other boundary in this collection bounds one from above, and gain does not help because gain raises it too.

Named by 18 essays across 3 fields — each of them below, with the objects they name alongside it.

Five resistances, five corner frequencies, and one total on the capacitor. computed by solving, not by drawing. The noise density at a 1 pF capacitor charged through 100 Ω, 1 kΩ, 10 kΩ, 100 kΩ and 1 MΩ, at 290 K. The densities are 100 times apart and the noise bandwidths 1.0e+4 times apart, in opposite directions, so the area under every curve is the same: 63.2762 µV against 63.2762 µV, and √(kT/C) is 63.2762 µV. The resistance has cancelled out of the answer, and the reason is that ½C⟨v²⟩ is the ½kT a degree of freedom in contact with a bath holds — which no arrangement of resistors can change. The claim is about the whole frequency axis and nothing less: inside a 15.9 MHz band the same five networks give 5.05 µV to 63.07 µV, a factor of 12.5.

The total that has no resistor in it

A larger resistor is noisier and makes a narrower filter, and the two dependences are exactly reciprocal: the density goes as the square root of the resistance and the noise bandwidth as its inverse. Five decades of resistance charging one picofarad therefore give five decades of corner frequency, two and a half decades of density, and one total — 63.2762 microvolts at every one of them, which is the square root of kT over C and contains no resistance at all.

noise · kT/C noise
A threshold crossed once, in 20k samples of noise. With no hysteresis the comparator changes its mind 22.7 times on average and as many as 29, on a signal that crosses the threshold once. The vertical bars are the range over twelve seeds. The expected number of extra transitions falls below a tenth at 3.57 standard deviations — so the hysteresis a threshold needs is set by the noise under it and not by the signal over it.

Two thresholds because there is a floor

A comparator with one threshold, watching a slow signal cross it once, changes its mind 22.7 times on average and as many as 29 — because there is noise under the signal and no threshold is ever crossed once. Hysteresis fixes it, and how much is needed is a multiple of the noise's own standard deviation rather than a voltage: 3.57 of them here. The multiple grows with how long the threshold is watched, and slowly — a hundredfold longer record needs three times the hysteresis, not a hundred times.

applied · Hysteresis
Every node of a Chebyshev 5, and the one that clips first. computed by solving, not by drawing. The largest signal each node of the realised network ever carries, over the whole frequency sweep, relative to the input. The output reaches 1.000 times the input and F0b reaches 4.537, so on a ±15 V supply the input can be driven to 3.31 V rather than 15.00 before something clips — and the thing that clips is not the output. With the floor at 249.7 nV that is 142.44 dB of range against the 155.57 dB an instrument on the output would report, a difference of 13.14 dB that no measurement at the output can see.

The ceiling is not at the output

A fifth-order Chebyshev's noisiest node is its output and its largest signal is not. F0b carries 4.537 times the input, so on ±15 V the range is 142.44 decibels and not the 155.57 an instrument on the output reports. Across fifteen realised filters the output reading spans 3.97 dB and the range they actually have spans 22.34 — and one family of the three has no internal peaking at all, at any order.

noise · Dynamic range
Same 2 ps of jitter: a floor at -121 dB, or a line at -91. computed by solving, not by drawing. A 3.337 MHz sinusoid sampled at 10 MHz with two clocks of identical root-mean-square jitter. One clock's timing error is independent gaussians and the other's is a sinusoid at 130 kHz. The total error power is the same — -87.43 and -87.55 decibels below the signal, against the closed form's -87.55 — and the pictures are not. The random clock spreads it over 2048 bins, -120.5 dB each; the modulated one puts it into two lines at 3.337 ± 0.130 MHz, -91.5 dB down. A specification in picoseconds does not choose between them.

A floor, or a line

Two clocks with identical two-picosecond jitter sample the same sinusoid, and the total error power is the same to a tenth of a decibel — the closed form an earlier essay computed, right for both. One of them puts that error across two thousand bins at −120 dB each; the other puts it into two lines at −91.5. The gap is the processing gain, it grows with the record length because a density falls and a line does not, and nothing in a specification quoted in picoseconds root-mean-square distinguishes the two cases.

digital · Aperture jitter
Two curves that only rise, and the gap between them that has a minimum. computed by solving, not by drawing. The source's own Johnson density, √(4kTR), and the amplifier's total input-referred density, √(4kTR + eₙ² + (iₙR)²), for a part with 4 nV/√Hz and 0.6 pA/√Hz. Neither curve has a minimum: the total is 4 nV/√Hz at a source of nothing, is 4.196 at 100 Ω, and rises without limit. What has a minimum is the ratio, at 6.67 kΩ, where the noise figure is 1.138 dB and the total density is 11.780 nV/√Hz — 2.81 times noisier in volts than at 100 Ω, where the noise figure reads 10.41 dB. The two statements are about different questions and the figure is what stops them being confused.

The bowl, and the bottom of it

An amplifier's noise figure has a minimum against source resistance and its input-referred noise has none: the 4 nV/√Hz part reads 1.138 dB into 6.67 kΩ and 10.41 dB into 100 Ω, and is 2.81 times noisier in volts at the first. The bowl is one shape scaled by its own depth, so the quieter the part the flatter it is — ±30.1 times for a decibel on the best of four, ±2.16 on the worst — and three parts of equal eₙiₙ share a floor of 0.3138 dB at optima 16 times apart.

noise · Device noise
Fed nothing, an eighth-order cascade sits 88 least significant bits from zero. computed by solving, not by drawing. Where each section of a 12-bit rounded cascade settles with zero input and a seeded state. Nothing decays to zero: a constant state survives whenever rounding returns it to itself, which needs only |y·(1 + a₁ + a₂)| ≤ q/2, and that denominator is small precisely because the corner is far below the sample rate. Each section's own band is 30, 31, 32, 33 least significant bits and the settled offsets are -27, -50, -70, -88 — accumulating, because a section's dead-band output is the next section's input and the next section passes direct current. In volts the offset halves with every bit added; in least significant bits it does not move at all.

Zero in, and not zero out

Rounding a filter's coefficients and marching it in double precision leaves out the other half: the products are rounded too. Put that in and a twelve-bit eighth-order cascade fed nothing at all settles two per cent of full scale away from zero and stays there — and the offset does not shrink with the word length, it grows as the square of how far the corner sits below the sample rate, reaching eighteen per cent at a hundred and twenty-eight times.

digital · Digital realisation
Twenty-four orderings, and 11 of them are choices. computed by solving, not by drawing. Every ordering of the four sections of an eighth-order 0.5 dB Chebyshev, at 16 bits, drawn against the two things an ordering decides. The horizontal axis is the round-off floor the arrangement adds — 24.2 least significant bits at best and 99.8 at worst. The vertical axis is the largest value any section's output reaches, which is what decides whether a word overflows: 0.088 of full scale at best and 0.699 at worst, a range of 18.0 decibels. 13 of the twenty-four are beaten on both counts by another ordering and are simply mistakes; the 11 on the lower-left frontier are the actual choices, and no one of them is best.

Which section goes first

A cascade of four biquads can be assembled in twenty-four orders, all of which realise exactly the same transfer function. They do not cost the same: the round-off floor runs from 24 to 100 least significant bits and the largest value any section reaches runs over eighteen decibels — and the two go opposite ways, so eleven of the twenty-four are genuine choices and thirteen are beaten on both counts by another arrangement.

digital · Digital realisation
The period's spread is 1.20 times what counting two crossings gives. computed by solving, not by drawing. 19999 periods of a relaxation oscillator with 5 mV rms of noise on its thresholds, computed from the exact flip instants rather than marched, at β = 0.5. The measured standard deviation is 3.4 ns and the closed form — three partial derivatives of the period with respect to the three draws it depends on — gives 3.4 ns. The estimate that counts two threshold crossings and divides the noise by the slope at each gives 2.83 ns, which is 17 per cent low. The curve is the closed form's Gaussian, drawn on the measured histogram rather than fitted to it.

The decision taken where the ramp is slowest

A relaxation oscillator decides at its thresholds, and a threshold is the one place on a charging exponential where the slope is smallest. Noise there costs 3.399 units of period against the 2.828 that counting two crossings gives, because a draw moves the crossing it is armed for and the level the next ramp starts from. Consecutive periods share that draw, so they are positively correlated and the jitter accumulates at 3.771 per root period rather than at 3.399. And at a fixed frequency there is a best hysteresis: β = 0.648, where β·ln((1+β)/(1−β)) = 1.

applied · Hysteresis
The floor a biased resistor is not standing on. computed by solving, not by drawing. A 100 kΩ resistor with 10 V across it. Its Johnson noise is 40.02 nV/√Hz and does not depend on the voltage; its excess noise is a 1/f density proportional to that voltage, 0.1 µV per volt per decade here, and the two are equal at 271 Hz. Below that the resistor is dominated by a generator that is a property of how it was made rather than of its resistance, and the crossover moves with the SQUARE of the voltage. Splitting the same total resistance into eight parts in series leaves the Johnson noise exactly where it was and divides the excess by √8 = 2.828, taking the total at 1 Hz from 660.2 to 236.4 nV/√Hz. With no voltage across it the second generator is absent rather than small.

The floor that is only a floor while nothing flows

Johnson noise depends on a resistance and a temperature and on nothing else, which is what makes it a floor. A real resistor has a second generator that depends on how it was made and on the voltage across it: 0.1 µV per volt per decade for a metal film, rising as 1/√f. On 100 kΩ with 10 V across it the two are equal at 271 Hz, and the crossover moves with the SQUARE of the voltage — 0.678 Hz at half a volt, 2.44 kHz at thirty. Splitting the same total resistance into eight parts in series divides the excess by exactly √8 and leaves the Johnson noise where it was.

noise · Johnson noise
1 pA in 10.0 kHz: 312 carriers a window, and a Gaussian of the same variance that looks right and is not in its tails. computed by solving, not by drawing. A direct current of 1 pA counted in windows of 1/(2B) for a noise bandwidth of 10.0 kHz: the mean count is N = I/(2qB) = 312.1, and the count is Poisson, drawn as bars, against a Gaussian of the same mean and variance, drawn as a curve. The variance is N exactly, so 2qI is right; the signal-to-noise ratio is √N = 17.67 and the skewness 1/√N = 0.0566. The count exceeds its mean by five standard deviations with probability 7.84 × 10⁻⁷, against the Gaussian's 2.87 × 10⁻⁷. A seeded arrival train counted in 20,000 windows gives a mean of 312.200 and a variance of 314.461.

The count under the density

Shot noise's density, 2qI, is exact at every current, because it is the variance of a count of independent carriers, and that count is Poisson at any size. Reading that variance as a Gaussian floor is not exact. A picoampere in a 10 kHz noise bandwidth is 312 carriers a window, and it passes five standard deviations above its mean 2.74 times as often as a Gaussian of the same variance says. At 10 femtoamperes it is 359 times as often, and 4.4 per cent of the windows are empty. A single pole reads a third more skewness than a count does, (4/3)/√N against 1/√N. The density is right and the shape is wrong, and the shape is what a threshold uses.

noise · Shot noise
At 100 Hz the bowl's bottom is at 2.11 kΩ and 3.10 dB, against 6.67 kΩ and 1.14 dB in the white region. computed by solving, not by drawing: the spot noise figure against source resistance of an amplifier with 4 nV/√Hz and 0.6 pA/√Hz of white noise, whose voltage noise has a flicker corner at 10 Hz and whose current noise has one at 1 kHz. At 100 Hz the spot densities are 4.20 nV/√Hz and 1.99 pA/√Hz, so the optimum is 2.11 kΩ — found by search on the drawn curve at 2.11 kΩ — with a floor of 3.102 dB. Dashed: the white-region bowl, 6.67 kΩ and 1.138 dB. A source left at the white optimum reads 4.492 dB at this frequency. The slider is the frequency.

The source resistance the flicker moves

An amplifier's optimum source resistance is the ratio of its voltage noise to its current noise, and both densities rise below their flicker corners — which are rarely the same frequency. With the voltage noise's corner at 10 Hz and the current noise's at 1 kHz, a part whose optimum is 6.67 kΩ at high frequency wants 2.11 kΩ at 100 Hz and 699 Ω at 1 Hz, tending to the white value times the square root of the ratio of the corners. Over the audio band the drift costs 0.012 dB; over a band from 1 to 100 Hz, choosing the white optimum costs 3.77 dB, and the spot optimum at the band's centre recovers all but a tenth of a decibel.

noise · Device noise
With a correlation of −0.3 between the two generators the bowl's bottom stays at 6.67 kΩ and its floor moves from 1.14 dB to 0.83. computed by solving, not by drawing, with the optimum found twice — in closed form and by a direct search of the noise factor, which agree to a part in a million. The 4 nV/√Hz, 0.6 pA/√Hz amplifier of the earlier essays, its two generators given a real correlation coefficient γ = −0.3. The noise figure against source resistance: the cross term 2γ·e·i·R adds the same fraction of the source's own noise at every resistance, so the bowl moves vertically and its bottom stays at e/i = 6.67 kΩ. The floor's excess over one scales as 1 + γ: 0.827 dB against 1.138 for independent generators. The slider is the correlation.

Two generators with one cause

The two-generator model of an amplifier assumes its voltage and current noise independent. Give them a correlation γ and the source sees a cross term, 2·Re(γ·e·i·Z*), linear in its resistance and its reactance. A real correlation leaves the quietest source resistance at e/i and moves the floor in proportion to 1 + γ: 0.83 dB instead of 1.14 at γ = −0.3. An imaginary one moves the optimum off the resistance axis — 5.77 kΩ with 3.33 kΩ of capacitive reactance at γ = 0.5j — and the noise figure's contours become circles about it; a resistive source cannot use it at all. If the two flicker components share one cause, the sign of the sharing decides the low-frequency floor: at 1 Hz, 3.9 dB or 18.0 instead of 15.1. And the correlation is measurable with three resistors, best with the middle one next to the optimum.

noise · Device noise
The Chebyshev 5's sections, each node's peak before and after equal-maxima scaling. computed by solving, not by drawing. Unscaled (lighter), section by section the largest signal anywhere inside reaches 4.537×, 3.109×, 1.000× the input, so the ceiling is 4.537× at F0b. With a gain of 0.220 at the input, 1.000 and 1.602 between sections and 2.833 at the output, every section peaks at 1× (darker) and the response is unchanged. The floor rises from 249.7 to 883.8 nV, so the range gains 2.16 dB of the 13.14 dB the internal peak was costing.

The ceiling a gain gives back

A fifth-order Chebyshev loses 13.14 dB of its range because its first section's capacitor node carries 4.537 times the input. The textbook repair is to scale: divide the signal in front of the loud section, restore it later, so that every node peaks at the same level. Done exactly, with silent gains of 0.220, 1.000, 1.602 and 2.833 and the response unchanged to the last digit, it lowers the ceiling to the input and raises the floor from 249.7 to 883.8 nV — and gives back 2.16 dB of the 13.14. Every section between the division and the restoration has its noise multiplied by what the signal was divided by. On the even-order Chebyshevs scaling loses half a decibel; on the seventh-order it recovers 3.77 of 22.45. Reordering the sections and scaling them together gives 4.75 dB. The rest of the ceiling belongs to the high-Q section and no gain moves it.

noise · Dynamic range
The quantisation error's power as a function of where the input sits, for four dithers. computed by solving, not by drawing; the error's mean square given the input, integrated over each dither's density through the converter's own quantiser, and checked against seeded draws to 6 × 10⁻³. Undithered it is the square of a sawtooth, x² up to half a step and (1 − x)² beyond. One uniform step makes it x(1 − x): zero at a code, a quarter of a step² between codes — the error's power is carried by the signal. Two steps (triangular) hold it at ¼ everywhere, and one step subtracted after the converter at 1/12 everywhere. Averaged over the input the prices are 3.01, 4.77 and 0.00 dB against the undithered 1/12.

One step of dither per moment

A whole step of uniform dither makes a quantiser's error average to zero wherever the input sits, and leaves its power at x(1 − x) steps²: zero at a code and a quarter between codes, so the noise rises and falls with the signal. Two steps — a triangular dither — hold the power at a quarter everywhere and leave the third moment swinging by 0.096 steps³; three steps fix that too. Each added step fixes one more moment of the error and costs a twelfth of a step² of power: 3.01 dB for one, 4.77 for two. Subtracted after the converter, one step fixes the error's whole distribution for 0.00 dB.

digital · Quantisation
Averaging an input that drifts 1 µV a cycle through a 1 pF switched-capacitor averager: too short a memory keeps the noise, too long a lag, and the best is 16.5 cycles at 27.2 µV. computed by solving, not by drawing, and seeded. A switched-capacitor exponential averager — 1 pF sampling capacitor, an equal damping capacitor for unity gain, memory set by the feedback capacitor — fed a ramp of 1 µV a cycle. The rms error against the input (solid) is the lag (dashed), (a/(1 − a))·r, and the switch noise (dotted), 2kT(Cs + Cd)/(Cf²(1 − a²)), together; seeded marches of sixty thousand cycles (dots) agree to 5%. The best memory is 16.55 cycles against (kT/(Cs·r²))^(1/3) = 15.88, with 27.2 µV of error: 15.5 µV of lag and 22.3 µV of noise.

The leak worth building in

An integrator that never forgets cannot follow an input that moves. Give a switched-capacitor integrator a deliberate leak — a damping capacitor that samples the output each cycle and takes its charge away — and it becomes an exponential average with a memory of Cf/Cd cycles. Fed an input drifting 1 µV a cycle, through a 1 pF sampling capacitor, too short a memory passes the switch noise and too long a memory lags the drift; the best, on the exact closed form and on seeded marches of sixty thousand cycles, is 16.5 cycles, for 27.2 µV of error against 89.5 µV in a single sample. The best memory follows a cube-root law, the cube root of kT/(Cs·r²), ten times the drift for a memory 4.64 times shorter, and at it the noise variance is twice the squared lag. And the leak is not free: the damping capacitor is switched too, and at unity gain it samples half of the averager's noise.

noise · kT/C noise
Fed nothing, a 12-bit eighth-order cascade sits 88 least significant bits from zero; with its rounding error fed back, never more than 1. computed by solving, not by drawing. The same cascade with its corner at 1 kHz and its clock 48 times higher, each section's state seeded at eight least significant bits and every product rounded to 12 bits, marched with no input. Plainly rounded, the sections settle at 27, 50, 70, 88 least significant bits — a constant state survives whenever rounding returns it to itself, and each section's offset is the next one's input. With each section's last two rounding errors added back with weights −2 and +1, the error reaches the output through (1 − z⁻¹)²/A(z), a constant state y needs (1 + a₁ + a₂)·y = 0, and the only one is zero: the largest excursion over the last two thousand samples is 1, 1, 1, 1 least significant bit, single isolated steps rather than a settled offset.

The rounding a section keeps

A fixed-point biquad that remembers its last two rounding errors and adds them back with weights −2 and +1 before it rounds again sends its error to the output through (1 − z⁻¹)²/A(z) instead of 1/A(z). For a low-pass clocked far above its corner that double zero lands exactly on the recursion's largest gain. Fed nothing, an eighth-order 12-bit cascade at 48 times its corner sat 88 least significant bits from zero; with the error kept, a constant state needs (1 + a₁ + a₂)·y = 0, its only solution is zero, and the output never strays more than one bit at any clock rate from 8× to 128×. The round-off floor at 128× falls 89 times, 6.5 bits, for two additions and a shift per section — and the white-noise model, which the plain cascade broke by a factor of ten at eight bits, holds to 2.3% from six bits to twenty.

digital · Digital realisation
Scaling a Chebyshev 5 with real 4 nV/√Hz amplifiers everywhere: 118.18 dB at equal maxima and 118.32 dB with no gain stages at all, so the gains cost 0.14 dB, where silent ones promised 2.16 dB. computed by solving, not by drawing: the dynamic range on ±15 V of a fifth-order Chebyshev with gains d^α in front of each section and after the last, against α. Every amplifier has a voltage noise of 4 nV/√Hz, the sections' own and the stages', and each stage carries a kilohm in its divider or lower feedback arm (solid). With every amplifier and gain silent (dashed), equal maxima recovers 2.16 dB over no scaling, 142.44 dB to 144.60 dB. With real ones: 118.32 dB with no stages, and with stages 115.75 dB at α = 0.2, 116.27 dB at α = 0.4, 116.86 dB at α = 0.6, 117.50 dB at α = 0.8, 118.18 dB at α = 1. Merely having the stages is a step down at the smallest α, since each is a real amplifier in the path, and the curve climbs from there to equal maxima. The response is unchanged to a part in a billion at every α.

The floor the gains bring

Equal-maxima scaling recovers 2.16 decibels of a fifth-order Chebyshev's range when its gains make no noise and its amplifiers make none either. Give every amplifier in the circuit a voltage noise of 4 nV/√Hz, the sections' own and the stages', and the unscaled filter reads 118.32 dB over a 1 MHz band and the scaled one 118.18: the last gain has nothing after it to filter its noise, so it multiplies 4 µV of wide-band noise by 2.83, and the lower ceiling is spent paying for it. At 1 nV/√Hz scaling costs 6.61 dB, and at 16 nV/√Hz it gains 0.99, so a noisier amplifier makes it look better. A narrower measuring band does not rescue it. On a Chebyshev 7, with a node 13.26 times the input, the same arrangement gains 6.15 dB.

noise · Dynamic range
Paralleling a 4 nV/√Hz amplifier on a 50 Ω source, summed through 100 Ω from each: the best is 1.19 dB at 140 parts, against 1.14 dB at 134 parts with a perfect summing node. computed by solving, not by drawing: the noise figure from a 50 Ω source against the number of amplifiers in parallel, each 4 nV/√Hz and 0.6 pA/√Hz, with a perfect summing node (dashed) and with their outputs averaged through 100 Ω each into one node (solid), which adds a thermal 4kTR/N at the node. The summing resistors' noise falls as 1/N exactly as the amplifiers' voltage noise does, so their ratio is the same at every N, and a summing resistor comparable with the resistance an amplifier's voltage noise is worth is a constant factor on that term.

The resistors that sum a hundred amplifiers

A hundred amplifiers in parallel across a 50 Ω source are an ideal transformer of ratio ten, and the summing network between them and the output is where the comparison was left. Its resistors turn out to be the least of it. N resistors averaging N outputs make the noise of R/N, falling exactly as the amplifiers' voltage noise does, so the resistor equal to a 4 nV/√Hz amplifier is about a kilohm at every N, and at 133 parts 200 Ω costs only a tenth of a decibel. The stage that was forgotten is whatever reads the sum. Averaging leaves it alone, so a following amplifier as good as one of the parts costs 12.14 dB, and each part needs a gain of 26 to bring that under a tenth. Parallel amplifiers then match a transformer with one ohm of winding.

noise · Device noise

Named alongside it

The objects these essays reach for when they reach for this one.

Design tradeoffJohnson noiseModel rangeRealisationDynamic rangeSeeded generatorCurrent noiseNoise figureOptimum source resistanceQuantisationVoltage noiseBiquad cascade

All concepts