Circuit Response
every model has an edge, and the figure carries it
Concept

Reconstruction — where it appears

Turning a sequence of samples back into a continuous waveform, exactly by summing shifted sinc functions and approximately by holding each value for a clock. The hold is what a converter really does, and its droop across the band is a consequence of the shape rather than of any filter.

Named by 11 essays across one field — each of them below, with the objects they name alongside it.

What the reconstruction returns, either side of 5.0 kHz. computed by solving, not by drawing. The Whittaker–Shannon sum is evaluated on the samples and compared with two things: the signal that was sampled, and the frequency the samples report. Below 5.00 kHz these are the same curve and the error is 4.88e-3 — the truncation of the sum at sixty-four samples either side, and nothing else. Above it they part: at 9.00 kHz the reconstruction is 1.59e-3 from the alias and 2.000 from the input. The small number is the interesting one. A reconstruction cannot be improved into the right answer, because it is already an exact answer to a different question.

An exact answer to a different question

The reconstruction that turns samples back into a signal is normally introduced as the thing that recovers what was there. Measured on both sides of half the sample rate it does something more interesting than failing: above the boundary it returns the alias to 1.6 parts in a thousand, which is the same accuracy it returns the input with below the boundary, and it is wrong about the input by twice the amplitude. Its error is not a degradation. It is exactness about something else.

digital · Sample rate The droop a zero-order hold imposes at 48 kHz. computed by solving, not by drawing. Holding each sample for a clock period convolves the output with a rectangle, so the spectrum is multiplied by a sinc: -0.143 dB down at a tenth of the sample rate, -0.912 at a quarter and -3.922 at half — which is exactly 20 log(2/π) and contains no design decision at all. The dots are the amplitude of the fundamental read out of the transform of the staircase itself, agreeing with the closed form to 0.008%. There is also half a sample of delay, 10.417 µs here, which is the reason a held reconstruction is not a droopy copy of the signal but a droopy copy that has moved.

The staircase on the way out

A converter does not emit impulses. It holds each sample for a whole clock period, which is a convolution with a rectangle and therefore a multiplication by a sinc — 0.14 dB down at a tenth of the sample rate, 0.91 at a quarter, and 3.92 at half, which is exactly 20 log(2/π). Nobody chose that droop and it is nearly eight times the half-decibel ripple of a Chebyshev passband. Measured on the transform of the staircase itself, it agrees with the closed form to 0.008%.

digital · Reconstruction The images a zero-order hold leaves, at 0.222 of the sample rate. computed by solving, not by drawing. A 10.67 kHz tone held at 48 kHz, with every line read out of a transform of the staircase itself. The sampled spectrum repeats at every multiple of the clock and the hold multiplies all of it by one sinc, so each image survives scaled by the sinc at its own frequency: the fundamental at -0.72 dB, the largest image (1fs−f, 37.3 kHz) at -11.60 dB, which is 10.88 dB of rejection. The sinc's nulls are exactly at the multiples of the clock and the two first-order images straddle the first of them without touching it — so the hold's rejection is 25.6 dB for a tone at 0.05 fs and 1.74 dB for one at 0.45, falling to nothing at half the clock. Measured and closed form agree to 0.026%.

The nulls are where nothing is

A zero-order hold multiplies the whole repeated spectrum by one sinc, so it attenuates every image at the image's own frequency and its nulls land exactly on the multiples of the clock. Nothing is ever at a null: the two first-order images straddle it, and the closer the signal comes to half the clock the closer they come to each other. The hold gives 25.6 dB of image rejection to a tone at a twentieth of the clock, 1.74 dB at 0.45 of it, and nothing at all at half — which is the frequency the band most needs it at.

digital · Reconstruction What flatness costs, in the two places it can be bought. computed by solving, not by drawing. The hold's sinc across a band ending at 0.40 of the sample rate, and the same sinc with a one-zero one-pole shelf fitted to its reciprocal over that band. The droop to be removed is 2.420 dB. Corrected digitally the band comes flat exactly and the flat level sits 2.420 dB below what the uncorrected converter gave at direct current, because nothing may exceed full scale — the price is the disease. Corrected in analogue the band comes flat to 0.2308 dB and the shelf is still rising where the images are, so the worst image at 0.60 fs comes up by 3.799 dB, which is 1.57 times the droop it removed — and that boost is between 3.4 and 4.7 dB at every band on the slider, while the droop it cures runs from 0.58 to 3.75. Neither correction changes the signal-to-noise ratio, because the droop never cost any.

Flatness, and the two currencies it is bought in

The hold's droop takes the signal and everything arriving with it down together, so it costs no signal-to-noise ratio at all — a fact that is never stated and settles what correcting it can possibly be worth. Corrected digitally the price is headroom and is exactly the disease: 2.42 dB of flatness for 2.42 dB of output level. Corrected by an analogue shelf the price is image rejection and is nearly a constant: between 3.4 and 4.7 decibels whatever the band, so it is eight times the droop at a fifth of the clock and nine tenths of it at forty-nine hundredths.

digital · Reconstruction What an oversampling ratio buys, and at two different rates. computed by solving, not by drawing. A 20 kHz band on a 48 kHz base clock, interpolated by ratios from 1 to 64. The hold's droop at the band edge falls with the SQUARE of the ratio — the fitted exponent over six doublings is -2.0113 — from 2.640 dB at the Nyquist rate to 0.0097 at sixteen times it. The nearest image moves out with the FIRST power, exponent 1.0222, from 1.40 times the band edge to 37.4. So one decision buys two things at rates differing by a factor of two in the exponent, and the third quantity — the poles a reconstruction filter needs for sixty decibels — collapses from 20.5 to 3.21 by a ratio of four alone.

One knob, and the two exponents it turns

Oversampling is quoted as buying one thing and buys two that improve at different rates. The hold's droop at the band edge falls with the SQUARE of the ratio — fitted exponent −2.011 over six doublings, from 2.640 dB at the Nyquist rate to 0.0097 at sixteen times it — while the nearest image moves out with the first power, exponent 1.022. The third quantity, the poles a reconstruction filter needs for sixty decibels, collapses from 20.5 to 3.21 by a ratio of four alone, because it is a logarithm of the second.

digital · Reconstruction Joining the samples with straight lines squares the hold's sinc: 5.28 dB of droop and 5.8 dB of image rejection, both doubled. computed by solving, not by drawing. A 20 kHz tone on a 48 kHz clock, reconstructed two ways: held for a whole clock period (dashed envelope, open stems) and joined sample to sample by straight lines (solid envelope, filled stems). Every line is read from a transform of that waveform itself. The held one comes out 2.640 dB down and its nearest image 2.92 dB below it; the interpolated one 5.280 dB down with the image 5.85 dB below. A straight line between samples is a triangle two clocks wide, which is a rectangle convolved with itself, so its transform is the sinc squared: every decibel doubles and the nulls stay where they were.

The pole a straight line is worth

A converter that joins its samples with straight lines instead of holding each one is convolving with a triangle rather than a rectangle, and its transform is the hold's sinc squared. Every decibel doubles: 5.28 dB of droop at a 20 kHz band edge on a 48 kHz clock instead of 2.64, and 5.85 dB of image rejection instead of 2.92. Both exponents of the oversampling ratio are unchanged. The second sinc is worth exactly one pole of reconstruction filter at every ratio, because a sinc's rejection of the nearest image is twenty times the log of that image's distance from the band edge, identically. A single analogue pole allowed the same droop gives a fraction of that rejection. The price is a whole clock of delay rather than half.

digital · Reconstruction 4 rectangles: the hold's sinc to the power 4, 10.56 dB of droop and the first image 11.7 dB down. computed by solving, not by drawing. A 20 kHz tone on a 48 kHz clock, reconstructed by a pulse of 4 rectangles convolved together — the hold, the straight line, the quadratic and the cubic B-spline for one to four — with the envelopes of all four drawn and the lines of the 4-rectangle waveform read from its own transform (stems). They agree with the sinc to the 4th power to 0.000 per cent. Droop 10.560 dB; the nearest image 11.69 dB below the signal, 4 times the hold's 2.92. The nulls stay on the multiples of the clock; each rectangle deepens everything else.

Four rectangles and no filter

A converter's output pulse can be any number of one-clock rectangles convolved together: one is the hold, two the straight line, four the cubic B-spline. Measured on its own waveform, n rectangles give the hold's sinc to the n-th power to a few parts in ten million, so each one rejects the nearest image by exactly what one analogue pole could at best — and each saves exactly one pole of reconstruction filter until none is left. At the Nyquist rate that is three poles of nineteen and a half, bought with 10.56 dB of droop. From about 2.8 times oversampling the cubic pulse needs no analogue filter at all for 60 dB, for 0.62 dB of droop at four times and two clocks of delay. The cost is that from three rectangles on the output no longer passes through its samples.

digital · Reconstruction With the crossover at 10% of the clock the straight line overshoots 13.7%, the hold with its pole 32.8%. computed by solving, not by drawing, marched at 160 steps a clock. A unit step through a loop whose plant is an integrator crossing over at 10% of the sample rate, reconstructed three ways: held (dotted), joined by straight lines (solid), and held then passed through the analogue pole that attenuates the nearest image, at 90% of the clock, exactly as much as the straight line's second sinc does (dashed) — a pole at 9.90% of the clock, at the crossover itself. Overshoot: 0.0%, 13.7% and 32.8%. The straight line buys the same image rejection for half a clock of delay; the pole buys it for forty-five degrees.

Half a clock against a pole

Inside a digitally controlled loop a converter's delay is phase at the crossover, and a straight-line output pays one more half clock than a hold: 180 degrees times the crossover over the clock. The analogue pole that rejects the nearest image as much as the straight line's second sinc does turns out to sit at the crossover itself — 0.990 of it when the loop crosses over at a tenth of its clock, sinc(r) of it in general — so it costs forty-five degrees however slow the loop is. By the phase estimate the half clock is the cheaper filter below 26% of the clock. Marched as a sampled loop the answer is 17.6%, and at a tenth of the clock a step overshoots 13.7% through the straight line against 32.8% through the hold and its pole, for the same image rejection measured on both waveforms.

digital · Reconstruction A sinusoid sampled 8 times a cycle, at the phase that puts its peak between two samples. computed by solving, not by drawing: the samples of a unit sinusoid at 8 a cycle, synchronous, at the sampling phase that hides its peak worst. 8 samples a cycle is 4 times the Nyquist rate and holds the waveform completely; the largest sample is still 0.9239, 7.61% below the peak, which is 1 − cos(π/8). Read straight off the samples the peak needs 22.2 samples a cycle for 1% and 70.2 for 0.1%.

The rate each reading needs

Twice the frequency is the rate at which a set of samples holds a sinusoid completely, and it is not the rate at which any particular property can be read off them. Eight samples a cycle — four times the Nyquist rate — hold the waveform, and their largest is still 7.61% below the peak; the largest sample needs 22.2 a cycle for 1% and 70.2 for 0.1%, because its error falls only as the square of the rate. A parabola through the three largest gets 1% at 8. A zero crossing found by a straight line between two samples is a hundredth of a cycle right at 5 a cycle, its error falling as the cube, because a sine is straight at its zero. The rms of whole cycles is exact from three a cycle — and at exactly two it reads anything from zero to √2. A slow rate with a long record of a steady signal does what a fast rate does, once the samples have slipped a whole interval past it: 42 cycles at 4.0236 a cycle.

digital · Sample rate Three waveforms at 16 samples a period, sampled at the worst instant: the largest sample of a sine is 1.92% short, of a triangle 12.5%, of a clipped sine 0. computed by solving, not by drawing: three waveforms with the same period and the same peak, sampled 16 times a period at the phase that puts the peak midway between two samples (dots). The sine leaves its peak as the square of the time, the triangle in proportion to it, and the sine clipped at nine-tenths of its height does not leave it at all for as long as it stays flat. The largest sample therefore falls short by 1.92% for the sine, 12.5% for the triangle, 0 for the clipped sine, at one rate, for three waveforms with the same period.

The peak that is a corner

The largest of a set of samples falls short of a sine wave's peak as the square of the sample interval, and that law belongs to the sine. Measured over every sampling phase, a triangle's corner falls short as the first power, 12.5 per cent at sixteen samples a period against the sine's 1.92, a peak whose curvature vanishes as the fourth power, and a sine clipped at nine-tenths of its height reads exactly above seven samples a period. The order in which a waveform leaves its peak is the whole of the law, and it also fixes how much better the average reading is than the worst. A real corner is round at some scale, so the law bends where the samples resolve its top harmonic, and a parabola through three samples helps a round peak, barely touches a corner and makes a flat one worse.

digital · Sample rate A Gaussian edge read at 3 samples per rise, at the worst sampling phase: straight chords between the samples say the rise is 8.78% from its true value. computed by solving, not by drawing: a Gaussian edge (solid), its samples at 3 per 10–90% rise at the sampling phase that reads worst (dots), and the straight lines an instrument's linear interpolation draws through them (dashed). The chord crosses 10 and 90 per cent earlier and later than the edge does, because a Gaussian edge curves in opposite senses at the two thresholds. The reading is 1.0878 rises against 1.

The samples a rise time needs

A rise time is read from two thresholds, and an instrument that draws straight chords between its samples is wrong at each by an amount that goes as the square of the interval. For a Gaussian edge at the worst sampling phase that is 5.02 per cent at four samples per rise and 0.818 at ten; the rule of thumb of three to five is a five per cent rule, and one per cent takes nine. The reading is not monotonic in the rate: above 20.9 per rise a first-order edge reads exactly at whole numbers and 0.046 per cent at 24.5, because its two errors subtract at one phase, and a Gaussian edge reads worse there because its two add. Reconstructing before reading needs 1.87 per rise for one per cent, and at four times the edge's 3 dB bandwidth the reading is still 11.7 per cent out.

digital · Sample rate

Named alongside it

The objects these essays reach for when they reach for this one.

Zero-order holdSample rateAnti imaging filterDesign tradeoffConvergence orderGroup delayNyquist rateAliasingFilter orderModel rangeOversamplingImage rejection

All concepts