Concept

Residual — where it appears

What is left over after a model has been fitted — the difference between an observation and what the fitted model predicts. It is not labelled: a wrong projection, a wrong datum and an ordinary measurement error all produce one, and they separate by how they scale rather than by their size.

Named by 24 essays across 5 fields — each of them below, with the objects they name alongside it.

What 4 parts per million of network strain leaves behind. Each arrow is where the best-fitting seven-parameter transformation leaves a marker, over 36 markers laid out as a grid across OSGB36's ground. The RMS residual is 1.64 metres and the worst is 3.00 metres. Seven parameters span the constant and linear parts of a displacement field; this one is quadratic, so no choice of the seven can reach it. The arrows are drawn 27× life size.

Where a fit leaves residuals

Seven parameters can carry a rigid motion and a size exactly. A triangulation network is neither, so the best possible transformation between two datums leaves metres on the table — in a pattern, not as noise — and which seven parameters come out depends on where the markers were.

datums · Datum
What grid spacing a tolerance buys. The worst bilinear interpolation error across OSGB36's ground, against the spacing of the table it is interpolated from, both axes logarithmic. The smooth shift falls by exactly four for every halving, which is what second-order interpolation does. Adding a 30 centimetre ripple 2 degrees across — three parts in a thousand of the 99 metre shift it rides on — moves the spacing needed for 20 millimetres from 1° to 0.125°, which is 64 times as many nodes.

When a formula is not enough

National mapping agencies distribute datum shifts as tables of numbers on a grid rather than as parameters. What decides the spacing that table needs is not the size of the shift — a hundred-metre shift tabulates coarsely, and a thirty-centimetre ripple riding on it does not.

datums · Datum
Three distances, two degrees of freedom. The Chamberlin trimetric construction with its three centres marked. A point is placed by intersecting circles of its true distance from each centre — but three circles in a plane do not meet in a point, and the three candidate positions obtained by taking the conditions two at a time are 17.0 km apart at the sample point. They are drawn here magnified 120 times about their own centroid, which is where Chamberlin's rule puts the point. The residual is not an error in the arithmetic; it is the amount by which the sphere refuses to be a plane, and it grows as the cube of the size of the region.

Three conditions are one too many

Two distances fix a point in a plane and a third has no freedom left to be satisfied with. Chamberlin's trimetric construction averages the three positions that satisfy two conditions each, and the spread between them — never zero anywhere, 22 km over North America, growing as the cube of the region — is the price of the extra clause.

choosing · Condition
Every candidate fitted to one map's graticule, ranked by what is left over. The map is drawn in Conformal conic over a region 40° tall centred at 45° north, and the projection is not told to the fit. Each candidate is evaluated at the same 121 graticule crossings, its own parameters are searched, the best plane similarity between its output and the picture is removed, and what remains is drawn as a proportion of the map's own width on a logarithmic scale. Conformal conic fits to 1.3e-10, which is the arithmetic's floor; the next candidate is 3.7e+7 times worse.

A map does not say what it is

Every map on this site is one the site drew, from a projection it chose. Every map a reader has ever used is the other kind — a picture whose projection is a sentence in a corner, a legend, or nothing at all. The graticule is enough to recover it: fit every candidate to the crossings and rank what is left over.

wrong · Identify
How large a map has to be before a wrong projection stops fitting it. Three rivals fitted to a Mercator graticule centred at 45° north, over regions from 1° to 70° of half-extent. The residual is the shape difference alone, with the best scale, rotation and offset removed, and both axes are logarithmic. The horizontal rule is a fifth of a per cent of the map's width — about the width of a drawn line on a printed sheet — and where a curve is below it, no measurement of that map can tell the two projections apart, however carefully it is made.

Two projections that cannot be told apart

Over a small enough region every projection is the same picture, so the question is how small. The answer is not one number: two conformal projections need twelve degrees of extent before their graticules can be separated, and two projections with different anisotropy separate below one.

wrong · Identify
Fitting a polynomial to Mollweide, and what each order buys. An affine, a quadratic and a cubic transformation fitted by least squares between the sphere and Mollweide over patches from 8° down to 0.5° radius, centred at 20°E 40°N. Each is a straight line on these axes and its slope is one more than its own degree: 1 → 2.00, 2 → 3.00, 3 → 4.00. That is not a coincidence and it is this ladder's subject: the first thing a model of degree d cannot represent is the term of degree d+1, so the affine model's error is governed by the second derivative — the flexion and skewness measured everywhere else here.

A local model has an order

Every georeferencing tool fits a polynomial between two coordinate systems and the choice of degree is usually made by counting control points. What it buys is an order of convergence — 2, 3 and 4, measured — and the first term an affine model cannot hold is the second derivative this ladder has spent five essays on.

distortion · Flexion
The half-extent at which each rival stops fitting a Gall–Peters graticule. For each candidate, the size of region at which its best fit to a Gall–Peters map first leaves a residual of a fifth of a per cent of the map's width. Below that size the two are the same picture. The numbers are half-extents in degrees of latitude, at 20° north, with the plane affine transformation removed; a bar at 90° is a rival that never separates at all within the range searched.

What a careless copy hides

A photocopier that stretches one axis is a nuisance to remove before a projection can be identified. Removing it costs more than it looks: an affine fit absorbs the entire difference between the cylindrical equal-area projections, so Gall-Peters and Behrmann become the same picture at any size, to sixteen decimal places.

wrong · Identify
Two parameter sets 100 metres apart, over the region they were fitted to. Each marker is drawn at a size proportional to how far the two transformations put it apart. The second set differs from the first by 100 metres of translation along the direction this network can least see, with the rotations and the scale re-fitted to absorb it — which is what a second agency's adjustment does when it chooses a different constraint. The worst disagreement anywhere in the region is 5.64 metres and the mean is 3.61. Applied at south-eastern Australia the same two sets differ by 193 metres, because the rotation that absorbed the translation here is a rotation of the whole Earth.

Two parameter sets, one transformation

Agencies publish seven-parameter datum transformations that differ by hundreds of metres in translation, and the usual reading is that one of them is better. Over the region either was fitted to they are the same transformation: a hundred metres of translation, re-absorbed by the rotations and the scale, moves a British coordinate by 5.6 metres and an Australian one by 193.

datums · Datum
The same ranking, with the right answer removed from the library. A map drawn in Mercator, fitted by every candidate except Mercator. Something still wins: Conformal conic, by a factor of 1.64 over the runner-up, leaving 0.4 per cent of the map's width unexplained. With Mercator in the library the winner's margin is 1.2e+13. The ranking always produces a name; what tells the two situations apart is how far ahead the name is.

When the answer is not in the library

Fitting twenty candidates to a map and ranking the residuals always produces a winner, which makes it a ceremony unless it can also produce a refusal. Held out of its own library, a Mercator map is named as a conformal conic, leaving 0.4 per cent of the map's width unexplained — and the quantity that tells the two situations apart is not the residual but the margin, which is 1.6 when the truth is absent and 10¹³ when it is present.

wrong · Identify
Two explanations for one residual, against the size of the region. A map in the right projection whose control coordinates are on the wrong datum, and a map fitted with the wrong projection and the right datum, both measured as a residual after the reproduction's scale, rotation and offset have been removed. The datum shift's residual is flat: it is the same 1.3e-6 at every size, because a similarity fit is very nearly what a datum shift is and it absorbs the rest. The wrong projection's grows by three orders of magnitude with the region. They are the same number below about a degree, which is where a residual stops saying anything about either of them.

A residual has more than one explanation

The method names a projection by fitting every candidate to a set of control points and taking the smallest residual. It has never been asked what else a small residual could be. A map drawn in the right projection from coordinates on the wrong datum leaves a residual of one part in a million — indistinguishable from noise, at every region size, because a similarity fit absorbs a datum shift almost exactly.

wrong · Identify
What each configuration can see, and what it cannot. The smallest eigenvalue of the fit's own normal matrix — how much the residual changes for a unit move in the worst direction of parameter space — for three parameterised candidates against six configurations of the same size. A zero is not a hard fit: it is a direction the control points cannot see at all, so every value of the parameter along it gives an identical residual. 2 of 18 are at the floor of double precision, and they are not the ones a reader would guess. Where none is, the spread between the best and worst arrangement is still Infinity at a fixed point count.

Where the control points are

Five rungs fit a library to a map and ask how much to trust the winner. None asks whether the parameters are recoverable at all. On control points along one parallel an equirectangular's standard parallel is not merely hard to find — it is invisible, exactly, and five hundred and twelve points on the same parallel are as blind as eight.

wrong · Identify
Five stations, ten distances, three spare. A braced quadrilateral with a centre point. Every distance between the corners and every distance to the centre is observed, 10 in all, each with a standard deviation of 8 mm. Holding one station and one bearing leaves 8 unknown coordinates, so the network has three degrees of freedom: three independent statements the observations make that could be contradicted. Everything the adjustment can tell anybody about the quality of the work comes out of those three.

A coordinate is the output of a solve

Six essays measure a tape, close a traverse, spread a misclosure and reduce a chain. The coordinate that comes out of the far end is the solution of a least-squares problem, and the problem has a decision in it that is not a measurement: what to hold fixed. Change it and every coordinate moves by centimetres while not one residual moves at all.

practice · Reduction
Believing a group takes away the redundancy that would test it. The thirteen degrees of freedom in this network, divided between the two groups, against the weight ratio the adjustment was told. At a ratio of a quarter the edges carry 12.1 of them and at sixteen they carry 0.07. A group's own variance can only be estimated from its own share, so a surveyor who is confident about an instrument has taken away the arithmetic that would have caught the confidence. The two curves sum to thirteen at every ratio, which is the identity that makes this a redistribution rather than a loss.

The weights are a guess the solve believes

Rung seven finds a decision inside the least-squares problem no residual can see: what to hold fixed. There is a second, made more often and thought about less. Every observation enters with a weight nobody measured, the weights move the coordinates by a factor of 1.8, and the standard check on them can be made to pass by a scaling that moves nothing at all.

practice · Reduction
The part of a request no conformal map can supply — scale falling with distance from the centre. The difference between the requested scale field and the nearest achievable one, over the patch, with the sign shown by colour. The RMS is 1.81e-1 in the logarithm of the scale and the worst single point is 4.91e-1. This is not an error: it is the part of the request that no conformal map of any kind can grant, and its SHAPE is the answer — it says where the request was impossible, which a single number cannot.

The nearest map to an impossible request

Rung seven found that not every distortion can be asked for. It never asked what happens when one is asked for anyway — and the answer has a shape: the achievable fields are the solutions of an elliptic equation, a request is a point off that set, and the nearest point leaves a residual whose floor is the curvature rather than the size of the ask.

choosing · Condition
How large a blunder has to be before the test notices. A blunder of increasing size put into the least-checked observation of a braced quadrilateral, with the standardised residual it produces. The horizontal line is the critical value the test uses, and the vertical one is the minimal detectable bias — δ₀σ/√r, which is 87 millimetres for this observation and is computed from the network's DESIGN, before any observation is made. Below it nothing is flagged; above it everything is. The observation's redundancy number is 0.144, so it is checked by a seventh of an observation and hides six-sevenths of whatever is wrong with it.

The blunder the network cannot see

A least-squares adjustment has no concept of a mistake. The smallest blunder its test will find in the least-checked leg of a braced quadrilateral is 87 millimetres, and by the time it fires a station has moved by nearly ten times the accuracy the same adjustment reports for it.

practice · Reduction
A plane fit swallows a datum shift, and keeps swallowing it. A map of OSGB36's ground drawn as though it were on WGS84, at seven sheet sizes. The upper curve is how far the drawing moves — a real 99-metre error on the ground — and the lower one is what survives the best similarity between the two, which is what a fit for the projection removes for free. The absorption runs from 99.68 per cent on a 1° sheet to 85.16 on a 60° one, and what is left is 3.9 parts per million of the map's own size even then — two microns on a sheet half a metre across.

The datum hides inside the projection's parameters

Six essays recover a projection from control points with the body it was drawn on taken as known. It is not known, and the fit cannot find it: a 99-metre datum shift is absorbed to 99.7 per cent on a two-degree sheet and to 85 per cent on a hemisphere, leaving eleven parts per million of the map behind.

wrong · Identify

The nearest equal-area map to an impossible request

Every number in the previous rung is inside the conformal achievable set, because Liouville's is the conformal condition. The equal-area set is one equation on two functions and never refuses: the same four requests are met to nine parts in a billion, and charged for in angle instead.

choosing · Condition

A rotation is not absorbed the way a shift is

The previous rung expected a datum's rotations to be the part a plane fit could not swallow. They are the part it swallows best — 93 times better than the translations over a hemisphere, and 24 times better per metre moved — and the reason is that the rotation which matters is a change of longitude, which is a symmetry of the map.

wrong · Identify

A condition imposed at points is not a condition

Nine rungs state a condition and solve it, and every solve imposes the condition at a finite set of samples because that is what a linear system is. With barely more equations than unknowns the residual the solver reports is 8.3 times too good — and refining the collocation twentyfold does not improve the map at all, it only makes the report honest.

choosing · Condition

The answer is a set

Eight rungs have produced a best fit — one projection, ranked first, with a margin. A best fit without a spread is not a measurement, and the spread is free: a control point has a width, and every candidate whose residual is inside that width has not been ruled out. At one per cent noise a four-degree region admits ten of twenty candidates and a forty-degree one admits exactly one.

wrong · Identify

The nodes were evenly spaced

The previous rung showed that refining an evenly collocated fit improves the solver's report and leaves the map alone. Moving the same number of nodes to the Chebyshev positions — crowded toward the corners, where a conformal map of a polygon is singular — makes the fit settle: 7.030 × 10⁻⁵ at forty-eight nodes and exactly that at every count above it, against an even fit that wanders by 43 per cent and never converges at all.

choosing · Condition

The sheet moved before it was measured

Nine rungs take control points off a map and assume the sheet they came from is the sheet the cartographer drew. Paper shrinks across its grain three times as fast as along it, and on a map whose grain runs along its own axis that shrinkage is EXACTLY a change of standard parallel — one per cent moves the recovered parallel by 0.57 degrees with the residual sitting at the solver's floor.

wrong · Identify

A map with no graticule

Ten rungs are handed control points, and a great many maps have none. Handed an outline with no labels on it at all, the method still works — and works better: the correspondence between ink and ground is recoverable exactly, because a similarity preserves ratios of arc length, and the margin on clean observations is 1.6 × 10¹⁰ against a graticule's 9.9 × 10⁶. What breaks it is noise, at three parts in a thousand.

wrong · Identify

What another common point buys

Rung three finds that a seven-parameter datum fit leaves a pattern rather than noise. Six per cent of the residual it reports is the transformation's own error and the other ninety-four is distortion no seven parameters can follow — so adding common points improves a term that was already small and cannot touch the one that is quoted.

datums · Datum

Named alongside it

The objects these essays reach for when they reach for this one.

Least-squaresVerificationToleranceSimilarity transformationDatumIdentifiabilityConformalityDegeneracyControl pointsIdentificationProjection identificationConditioning

All concepts