Concept

Oversampling — where it appears

Sampling well above the rate the signal needs, so that the anti-alias filter has decades rather than an octave to work in. It also spreads a quantiser's noise over a wider band, of which only the signal band is kept, which is the whole basis of noise shaping.

Named by 7 essays across one field — each of them below, with the objects they name alongside it.

The sample rate each anti-alias filter demands for 80 dB. computed by solving, not by drawing. A 20 kHz passband, and each filter must be 80 dB down by the frequency that folds back into it. The required rate follows, and it is a property of the filter rather than of the converter: Bessel 3.53× Nyquist, Butterworth 2.08×, Chebyshev 1.53×. The elliptic design at a selectivity of 0.8 is refused: its equiripple stopband has a floor at -74.1 dB, which is above the requirement at every frequency, so no sample rate satisfies it. At a selectivity of 0.5 the same order needs 1.34×. The floor is the selectivity's, not the order's.

What the filter in front costs

The filter that keeps a converter honest is normally chosen for its skirt. Measured against one requirement — eighty decibels down by the frequency that folds back into a 20 kHz band — the choice is not a decibel or two of skirt but a factor in the clock: Bessel demands 3.53 times Nyquist, Butterworth 2.08, Chebyshev 1.53. And one design is refused outright, because an elliptic stopband is a floor rather than a slope and no sample rate reaches past a floor.

digital · Anti-alias
One bit, oversampled — and where the quantisation noise went. computed by solving, not by drawing. A first-order modulator is marched forward one sample at a time with a one-bit quantiser inside the loop, and the noise inside the band is read out of the transform of the error. It falls by 8.99 dB for every doubling of the oversampling ratio — measured 9.33, 10.12, 6.96, 9.54 — against 3.01 dB for plain oversampling, which is drawn beside it from the same starting point. The loop does not make less noise; it moves the noise out of the band, and at a ratio of 128 one bit is worth 9.18.

One bit, and where the noise went

Sampling faster spreads a fixed quantity of quantisation noise over a wider band, so the part inside the band of interest falls by 3.01 dB for every doubling — half a bit. Putting the quantiser inside a loop with an integrator does something different in kind: measured on a modulator marched forward one sample at a time, with its test tone inside the band the ratio is quoted over, the in-band noise falls by 8.99 dB per doubling. At an oversampling ratio of 128, one bit is worth 9.18 — and the octaves scatter by a decibel each, which is the loop telling the truth about what its error is made of.

digital · Noise shaping
A second integrator is 5.8 more decibels an octave, and a third 5.4 more. computed by solving, not by drawing. Modulators of order 1, 2, 3 marched one sample at a time with a one-bit quantiser, their in-band noise read from the transform of the error with the test tone a quarter of the way up the band. The measured slopes are 8.17, 13.93, 19.33 decibels per doubling of the oversampling ratio, against the 9, 15, 21 the white-noise argument predicts and the 3.01 plain oversampling gives. Each order is short of its own prediction by about a decibel, in the same direction, which is the error in the band not being white. The straight lines are each ladder's prediction drawn through its own first point, so what is compared is a slope against a slope.

The loop that is worse at full scale

A second integrator in a one-bit loop takes the shaping law from nine decibels an octave to fourteen, and a third to nineteen. What it charges is not in decibels at all: past six tenths of full scale the ratio starts falling, and a fourth integrator's states run away at seven tenths. The best input to a second-order modulator is 0.6 of the reference it is measured against — an amplitude boundary of exactly the kind this collection is built for, on the one object in the field that has no continuous output to draw.

digital · Noise shaping
What a cascaded modulator is worth, against how well its two paths match. computed by solving, not by drawing. Two first-order loops marched sample by sample at an oversampling ratio of 64, with the first stage's quantisation error taken as the difference between what its comparator said and what was presented to it — nothing here reads a state a real converter could not. Perfectly matched, the cascade gives 72.5 decibels against the first stage's own 47.5: second-order shaping out of two first-order loops, neither of which can be unstable. The gain with which the first error reaches the second stage is then given an error, and the flat left-hand half of the curve is the arrangement working. It costs three decibels at 5.29 per cent, which is a capacitor ratio — achievable, and not free, and not something the digital side can measure or correct.

Two loops, and the mismatch between them

The rung below marched single loops of second, third and fourth order and found the amplitude at which each stops working, falling with the order — which is why nobody builds a fourth-order single loop. The standard answer is two first-order loops with the first one's error fed to the second and differentiated back out, giving second-order shaping out of parts that cannot be unstable. The cancellation is between an analogue path and a digital one, and it is worth 25 decibels until the two differ by five per cent.

digital · Noise shaping
Fed nothing, an eighth-order cascade sits 88 least significant bits from zero. computed by solving, not by drawing. Where each section of a 12-bit rounded cascade settles with zero input and a seeded state. Nothing decays to zero: a constant state survives whenever rounding returns it to itself, which needs only |y·(1 + a₁ + a₂)| ≤ q/2, and that denominator is small precisely because the corner is far below the sample rate. Each section's own band is 30, 31, 32, 33 least significant bits and the settled offsets are -27, -50, -70, -88 — accumulating, because a section's dead-band output is the next section's input and the next section passes direct current. In volts the offset halves with every bit added; in least significant bits it does not move at all.

Zero in, and not zero out

The rung below rounds a filter's coefficients and marches it in double precision, and its own list of what it did not do names the other half: the products are rounded too. Put that in and a twelve-bit eighth-order cascade fed nothing at all settles two per cent of full scale away from zero and stays there — and the offset does not shrink with the word length, it grows as the square of how far the corner sits below the sample rate, reaching eighteen per cent at a hundred and twenty-eight times.

digital · Digital realisation
Against its own shaping the error is 17.4× tonal, not 51×. computed by solving, not by drawing. The share of an order-1 loop's in-band error sitting in its five largest lines, from 0.02 to 0.9 of full scale, with both nulls drawn. The lower level is 1.953 per cent — five lines of a FLAT error over 256 — and it is what this measurement has always been quoted against. The upper level is 5.74 per cent, which is what five lines of the loop's OWN shaping hold with no tone anywhere in them. Measured against the first the error is 51 times tonal at 0.02 of full scale and 26 at 0.9; against the second, 17.4 and 8.9. The direction survives the correction and the size does not.

A floor, or five tones

The field's sharpest statement about a one-bit loop is that three quarters of its in-band error sits in five lines, against the 1.953 per cent a white error would put in any five — a factor of thirty-eight. The comparison is to a white error, and a shaping loop exists to make its error anything but white. Measured against the loop's own transfer function, which the loop reproduces line by line to a part in five hundred when it is dithered, the same error is 17.4 times tonal at a fiftieth of full scale and 8.9 times at nine tenths. And 99.5 per cent of it at the quiet end is two harmonics of the input.

digital · Noise shaping
What an oversampling ratio buys, and at two different rates. computed by solving, not by drawing. A 20 kHz band on a 48 kHz base clock, interpolated by ratios from 1 to 64. The hold's droop at the band edge falls with the SQUARE of the ratio — the fitted exponent over six doublings is -2.0113 — from 2.640 dB at the Nyquist rate to 0.0097 at sixteen times it. The nearest image moves out with the FIRST power, exponent 1.0222, from 1.40 times the band edge to 37.4. So one decision buys two things at rates differing by a factor of two in the exponent, and the third quantity — the poles a reconstruction filter needs for sixty decibels — collapses from 20.5 to 3.21 by a ratio of four alone.

One knob, and the two exponents it turns

Oversampling is quoted as buying one thing and buys two that improve at different rates. The hold's droop at the band edge falls with the SQUARE of the ratio — fitted exponent −2.011 over six doublings, from 2.640 dB at the Nyquist rate to 0.0097 at sixteen times it — while the nearest image moves out with the first power, exponent 1.022. The third quantity, the poles a reconstruction filter needs for sixty decibels, collapses from 20.5 to 3.21 by a ratio of four alone, because it is a logarithm of the second.

digital · Reconstruction

Named alongside it

The objects these essays reach for when they reach for this one.

QuantisationNoise shapingDesign tradeoffEffective bitsIdle tonesSample rateSigma deltaStabilityAliasingAnti-alias filterAnti imaging filterBiquad cascade

All concepts