Series

Sensitivity — the series

5 essays on one idea, from the one that introduces it to the one that assumes the rest.
  1. A difference quotient is best at a step of 1e-5, and is 1e+6 times worse at 10⁻¹¹. computed by solving, not by drawing. The worst disagreement between the adjoint network's derivatives and a central difference quotient of the same quantities, against the fractional step the quotient is taken with, on a 7-element ladder at 1000 Hz. The curve has a minimum because two errors pull opposite ways: the curvature the quotient neglects falls as the square of the step, and the digits its subtraction destroys rise as one over the step. The best it reaches is 1.4e-9, against the 2.3e-11 that the two-thirds power of the machine epsilon predicts. The exact route costs 2 solves against 15, and has neither error term.

    Every derivative, and the one that is zero

    How much does this response move if that capacitor is one per cent out? A difference quotient answers it one component at a time, in two solves each, and its best possible accuracy is four parts in a hundred million. Transposing the matrix and solving once more answers it for every component at once, exactly. Pointed at a claim this collection has made since its ladder essay and never tested directly — that a doubly terminated ladder's response is stationary in every element at its passband maxima — it returns two parts in ten billion, where the cascade realising the identical response returns 0.72.

    part 1 · networks
  2. Where one pole goes when each component is 5% high. computed by solving, not by drawing. A series R–L–C, its poles recovered by rooting the determinant, and the derivative of the upper one with respect to each element taken exactly from the two null vectors at the pole. The dashed lines are the first-order prediction for a 5 per cent change; the filled circles are where the root actually goes when the element is changed and the determinant re-rooted. The three directions are the argument: the resistance moves the pole along a circle of constant radius, because the natural frequency does not contain it — its normalised sensitivity has a real part of 3.1e-16. The inductance and the capacitance each carry exactly −½ of the radius, and imaginary parts that are exact negatives. At 5 per cent the prediction is out by 0.122 per cent of the pole's own magnitude.

    The derivative of a root

    The rung below turns one transposed solve into the derivative of a response with respect to every element, and found a doubly terminated ladder stationary at its ripple peaks to a part in ten to the eighth. A pole is a different object — a value of s at which the matrix loses rank — and its derivative comes from two null vectors and a division. Pointed at the same two realisations, the ladder's advantage is a factor of 2.17, not eight orders of magnitude: what is stationary is the magnitude at one frequency, and it says nothing about where the poles are.

    part 2 · networks
  3. At a stationary point a tolerance has a mean, not a spread. computed by solving, not by drawing. Six hundred ladders with every reactance drawn independently from ±1 per cent, measured at the ripple peak and at a frequency between the peaks. Away from the peak the distribution is centred on nominal and 325 of 600 are above it. At the peak none is: the whole distribution lies below, with a mean of -0.0030 per cent and a worst case of -0.0140. A yield calculation that assumes a symmetric spread at a frequency that has a stationary point is wrong in both directions at once — it allows parts above a limit that cannot exist, and it misses that the whole batch has moved.

    The tolerance that can only take away

    At a doubly terminated ladder's ripple peak the first derivative of the magnitude with respect to every reactance is zero to ten digits, which the rung below measured and which says nothing about how much the response moves. This says how: every second derivative is negative, so of six hundred ladders built from one per cent components not one is above nominal, the mean has shifted rather than the spread having grown, and doubling the tolerance quadruples the damage instead of doubling it.

    part 3 · networks
  4. Five tolerances, and the response moves in two directions. computed by solving, not by drawing. The eigenvalues of the relative second-derivative matrix of a fifth-order 0.5 dB Chebyshev ladder's magnitude at its lower ripple peak, over its five reactances. Two are of order one — -0.9473 and -0.8051, both negative — and the other three are 3.9e-9, which is zero at the precision the arithmetic has. So the quadratic form is negative semi-definite of rank two, and there is a three-dimensional subspace of component errors that the peak cannot see. The open circles are the same matrix computed by four re-solves per pair, sharing no adjoint arithmetic with the filled ones: they agree to parts in ten thousand on the two that are there and place the three zeros about two decades higher, which is the price of differencing a difference.

    The three tolerances that do nothing

    The rung below computed every second derivative of a ladder's magnitude at a ripple peak, found them all negative, and built six hundred ladders to argue that no combination of tolerances could raise the response. The whole matrix says so outright — and says something six hundred samples could not have found, because a sample of a five-dimensional box never lands on a three-dimensional subspace: two of the five eigenvalues are of order one and the other three are nine decades down.

    part 4 · networks
  5. The most sensitive direction at one ripple peak is not the one at the next. computed by solving, not by drawing. The eigenvector of the largest eigenvalue of the relative curvature matrix, at each of the 2 ripple peaks of a 5th-order 0.5 dB Chebyshev ladder, drawn as its components over the reactances in order along the ladder. Every one is symmetric under the ladder's own reversal and no two of them are the same direction: the largest overlap between any pair is 0.0603, which is 86.5 degrees apart. The eigenvalue that belongs to them grows from -0.9473 at 554.9 Hz to -12.005 at 897.9 Hz, a factor of 12.7, so the peak nearest the band edge is both the most sensitive place in the passband and sensitive to a different combination of parts. Each direction is confirmed by a second computation of the whole matrix — four re-solves per pair, sharing no adjoint arithmetic — which returns the same direction to 7.6e-7 radians.

    The direction a response is most sensitive to

    The rung below diagonalised a ladder's curvature at one ripple peak and read only the eigenvalues: rank two of five, three directions of nothing. The eigenvectors say what the two directions are, and doing it at every peak rather than one changes the conclusion. The most sensitive combination at 554.9 Hz and the one at 897.9 Hz are 86.5 degrees apart, the curvature that belongs to them grows from −0.556 to −75.4 across a ninth-order passband, and exactly one combination survives the whole band at every order — which turns out to be the ripple depth.

    part 5 · networks

All series