Concept

Covariance — where it appears

The matrix that describes how the errors of several quantities vary together, and how large each of them is. Pushing one through a projection's Jacobian turns a positional uncertainty on the ground into an error ellipse on the page, which is Tissot's own construction pointed at a different input.

Named by 23 essays across 5 fields — each of them below, with the objects they name alongside it.

One instrument, one covariance, drawn where Mollweide puts it. The same measurement is made at every point: 5 m east by 5 m north, uncorrelated, which on the ground is a circle. Each ellipse is that covariance pushed through the projection's own Jacobian and drawn 26,000 times life size. On Mollweide the axis ratio reaches 4.15, so an instrument that is equally good in every direction is drawn as though it were not.

An error ellipse is an indicatrix

A positional covariance pushed through a projection is the same matrix sandwich that produces Tissot's indicatrix, so the error ellipse drawn on a map and the distortion ellipse drawn beside it are the same ellipse. A five-metre circular accuracy is drawn at an axis ratio of 3.04 on one common projection — and the same projection draws a genuinely lopsided 304 by 100 metre error as a perfect circle.

distortion · Precision
10,000 observations of one place, averaged 120 times. Left: 400 single observations of the same place, with a 60-kilometre standard deviation east and north, drawn across ±400 km. They are scattered about the truth and their average is unbiased on the ground. Right: 120 independent averages of 10,000 such observations each, computed on the page and taken back to the ground, drawn across ±1.8 km. The cloud is tight, as averaging ten thousand things should make it, and it is not centred on the cross: it sits 489 m away, against 403 m predicted by the projection's second derivative alone.

The average of noisy positions moves

Average sixty thousand scattered observations of one place on a Mercator map and the answer is 404 metres too far north — at every sample size, because it is a bias and not noise. The same average on the Lambert cylindrical equal-area is 404 metres too far south, the two being ½ (σ²/R) tan φ and its exact negative, and on the plate carrée it is not displaced at all.

distortion · Precision
Five stations, ten distances, three spare. A braced quadrilateral with a centre point. Every distance between the corners and every distance to the centre is observed, 10 in all, each with a standard deviation of 8 mm. Holding one station and one bearing leaves 8 unknown coordinates, so the network has three degrees of freedom: three independent statements the observations make that could be contradicted. Everything the adjustment can tell anybody about the quality of the work comes out of those three.

A coordinate is the output of a solve

Six essays measure a tape, close a traverse, spread a misclosure and reduce a chain. The coordinate that comes out of the far end is the solution of a least-squares problem, and the problem has a decision in it that is not a measurement: what to hold fixed. Change it and every coordinate moves by centimetres while not one residual moves at all.

practice · Reduction
A chain of stations, its positions' uncertainty and its baselines'. Nine stations held at the left-hand one, with every neighbour, second neighbour and third neighbour observed. The filled ellipses are each station's own uncertainty, which grows without limit as the chain runs away from the point it is held at — 7.5 mm at the near end and 574 mm at the far. The open ellipses above each leg are the uncertainty of the baseline, drawn at the same scale: they hardly grow at all, because almost everything that is wrong with one end is wrong with the other in the same direction.

The difference of two coordinates

Three essays give a single coordinate a width. Every practical use of one is a difference of two — a distance, a bearing, a movement, an area — and the width of a difference is not the two widths combined, because the errors are not independent. Far from its datum a one-leg baseline is six times more certain than the positions it joins.

distortion · Precision
Four layouts, the same five stations, the same ten distances. Every panel has five stations, all ten distances between them, the same instrument precision and the same three degrees of freedom. The ellipses are the error ellipses of the adjusted coordinates, drawn at one common exaggeration, and they are computed from the geometry and the weights alone — no observation value enters any of them. The worst semi-axis runs from 11.1 millimetres to 232, a factor of 20.9, and the difference is entirely where the marks were put.

The network's answer is decided before it is measured

An adjustment is usually judged by what it does with observations. Every quantity a specification is written about — the error ellipses, the redundancy numbers, the smallest detectable blunder — is a function of the geometry and the weights alone, and does not contain an observed value anywhere. Four layouts of five stations with the same ten distances differ by a factor of 20.9 in their worst coordinate.

practice · Reduction
A transformation is more certain in some places than others. The horizontal position uncertainty a Helmert transformation carries, from the stated widths of its own seven parameters, along three meridians. It runs from 40 mm to 68 mm — a factor of 1.71 — and it falls towards the poles, because the rotation terms act on the distance from the Earth's axis. A single figure quoted for "the accuracy of the transformation" is the value at some latitude nobody wrote down.

The seven parameters have their own uncertainty

Nine essays on this ladder print a datum transformation as seven exact numbers. Every published set is the output of a least-squares fit and arrives with standard errors as much a part of the result as the parameters — and pushing those widths through to the ground gives an ellipse, not a number, that is 68 mm across at the equator and 43 mm at 70°.

datums · Datum
Two defensible answers from the same four sights, and they are kilometres apart. Four bodies within sixty degrees of one another at azimuths of 60°, 80°, 100°, 120°, each sight carrying an independent error of about 2 km and the same common error of 3 km. The four lines are nearly parallel, so a step towards every body at once is almost exactly a step to the south. The two-unknown least-squares point takes that step and lands 3.66 km from the ship; the three-unknown fit, which solves for the common error as well, refuses it and lands 2.22 km away — its estimate of the common error being 1.87 km. Neither is wrong. They are the two ends of one exchange.

What the extra unknown costs where nothing can see it

Four lines of position can estimate a common error in every sight as well as the position. The estimate is honest — three kilometres put in comes back as 2.8 — and where the residual is blind, its scatter is plus or minus thirty-one, and the fix that carries it is scattered fourteen kilometres from the ship against the biased fix's two and a half. Letting the residual choose between the two is worse than either, because a test with no power is a one-in-twenty lottery on the worse answer.

paths · Position fix
The triangle and the ellipse are two pictures of the same three sights. Three bodies at azimuths of 20°, 140°, 250° with independent errors of 2 km, drawn twice: as the cocked hat their lines bound, dashed, and as the 95 per cent confidence ellipse of the least-squares point, outlined. The ellipse is 4.25 by 3.78 km and covers 50.5 km²; the average hat from the same sights covers 7.06. The triangle is seven times the smaller and holds the ship a quarter of the time; the ellipse holds it 95 per cent of the time, which is what it was constructed to do. The hat is a picture of how much the sights disagree, and the ellipse is a picture of where the ship is.

A confidence ellipse is honest only where the sheet keeps angles

The cocked hat covers seven square kilometres and holds the ship a quarter of the time; the confidence ellipse from the same three sights covers fifty and holds it ninety-five per cent, which is what it was built to do. On a plotting sheet whose longitude is not corrected for latitude that ellipse fails in two unrelated ways — its centre is displaced, which costs coverage and depends on the navigator's own assumed position, and its shape is misread, which costs nothing but meaning and depends only on the latitude.

paths · Position fix
A local station's error ellipse is the national network's, arriving. Three orders of a stated survey, each a network of distances adjusted with the stations of the order above held fixed: a national network of seven stations 60 km apart, a regional one of ten stations inside one of its triangles, and a local one of five stations about a kilometre apart tied to three regional stations 10 km away. Every error ellipse is drawn at one scale in all three panels. Dashed: the ellipse each adjustment reports from its own observations. Solid: the full ellipse, with the error of every order above carried in. The national network's centre station is its origin and its eastern station fixes its bearing, so the one has no ellipse and the other's is a line; it reports its full error because nothing is above it. The local stations report 11.2 mm and carry 59.4 mm: their solid ellipses are the size of the national network's at that place.

The control carries the error of every network above it

A local survey is adjusted with its control stations held fixed, and the error ellipses it reports come from its own observations alone. On a stated three-order network a local station reports 11 millimetres and sits 59 from where the national origin puts it: 52 of them from the national order and 26 from the regional. Its own residuals can see almost none of that. What it does own outright is its lengths, and nothing of those is inherited.

practice · Reduction
Pins at one place move where the picture sits; pins at four reshape it. The best flat picture of four cities, fitted to every distance with a tolerance of 1 per cent, one bearing a pair to 0.01 radians, and pins to the sheet good to 50 km. Each ellipse is the error in a city's position relative to the picture's centre — its shape, which no shift changes — drawn 30 times its size. Solid: the part the distances and bearings put there. Dashed: the part the pins put there. Pinned at London alone, the pins put 0.00 km into the shape and the places 63.0 km. Pinned at all four, the pins put 30.5 km and the places 29.7 km, and the shape as a whole is 42.6 km against 63.0.

A second pin is a measurement of the places

Counted exactly, a picture of places is a direct sum: the distances and bearings spend its shape and two pins spend where it sits on the sheet. Given tolerances, the sum survives in one form and fails in another. Pins at one place put none of their error into the shape at any tolerance, and wherever the pins are, their average takes none of the distances' error. But every place pinned after the first is a statement about the geography, and held exact it makes the shape worse once its error passes about two thirds of the shape's own.

impossibility · Embedding
The same baseline, turned. The part of a 20 km height difference a degree-360 geoid model omits, against the direction the baseline runs, at four anisotropy ratios. A ratio of one is the model rung 9 used and is a flat line — the isotropic covariance cannot depend on a direction, by construction, which is the whole of the objection. At a ratio of two the same baseline omits 165 millimetres along the grain and 241 across it.

The correlation is not the same in every direction

Every number in the measurement before this one came out of Σ cₙ Pₙ(cos ψ) — a covariance that depends on the angular distance and nothing else. Ground has grain: at a modest anisotropy the same 20 km baseline omits 165 millimetres along it and 241 across, and the isotropic answer understates the worse direction by 18.4 per cent.

datums · Height
Weighting the low sight turns the region the fix is in. Four bodies, three of them between 44° and 58° up on one side of the ship and one 5° up behind, with each sight's error made of a sextant part of 0.5′ and a tenth of its refraction correction: 0.94, 0.95, 0.93 km for the high bodies and 2.05 km for the low one. Solid: the 95 per cent ellipse of the fit that weights each sight by its variance, 2.30 by 1.55 km. Dashed: the ellipse a navigator draws who gives every sight the same variance, 2.63 by 2.02 km, its long axis turned 20.1° from the weighted one. Dotted: where that unweighted fix actually scatters, 2.98 by 1.57 km, turned 27.7° from the ellipse drawn for it. All three are centred on one point.

A low sight is worth keeping only if it is weighted

A body five degrees above the horizon is seen through so much air that its refraction correction is ten times a high body's, and a tenth of that correction uncertain doubles the sight's error. Given the same weight as the others, a sight below seven degrees makes the fix worse than throwing it away; weighted by its variance it never does. The ellipse drawn without weights is turned twenty degrees from the right one, and a navigator who must guess the weights loses far less by guessing high.

paths · Position fix
Ties ten kilometres long locate the control along themselves and hardly at all across. The local order of the stated survey: five stations about a kilometre apart, and the twenty-five lines from them to one another and to three control stations 10 km away. Adjusted on its own lines, the network knows where each control station lies along its ties to within a few centimetres and across them only to 179.0 mm, because five lines leaving a cluster a kilometre wide are nearly parallel ten kilometres out. The long ellipses at the control stations are that knowledge, drawn at one scale. At the local cluster, drawn at the same scale: dashed, the error the held-fixed adjustment reports for each station, 8.0 mm on its long axis at the first station; solid, the same station's own error after an equal-weight rigid fit of the free network onto the three control stations, 70.2 mm. The equal-weight fit trusts each control coordinate as much as every other, and the across-tie ones are worth almost nothing.

Three numbers are all a local survey can check of its control

Adjust a local network on its own lines, then fit it onto its three control stations, and the misfit at the control is the only place the control's error can show. It is exactly the excess the held adjustment's variance factor already carried, counted on three degrees of freedom instead of fifteen, and it catches a disturbed monument 79 times in a hundred where the held report catches it 49. Give the fit a scale and it hides 98 per cent of that excess, and lends the control's error to every length.

practice · Reduction
Weighted by their residuals, six sights hand the low one six times its share. Six bodies seen from one ship: five between 44° and 61° up between east-north-east and east-south-east, and one 5° up due south, alone in its direction. Along each bearing, two bars: the share of the fix's weight the sight's altitude earns it, and the median share it ends with when every sight is weighted by its own residual and the fit is repeated until the weights settle. The low sight earns 4.0% and ends with 25.0%; the five good ones earn about 19% each and end with 1.8% to 3.1%. Bar length goes as the square root of the share.

Weighted by what it disagrees with, the fix trusts the sight it leans on

With six sights and two unknowns, the residuals seem to offer a way to find the bad sight without knowing the weather: weight each line by how little it disagrees, and solve again. One step of that gives a low body almost exactly the weight its altitude would, 4.5 per cent against 4.0. Every further step walks it away. Iterated until the weights settle, the fit is worse than weighting nothing in all four arrangements tried. Where the low body stands alone in its direction it ends with six times the weight it earns, because the fix leans on its line and its residual shows only 46 per cent of its error.

paths · Position fix
Moved five centimetres, one station of three looks like all three, and one of five looks like itself. The local cluster at the centre, tied to three control stations (left) and to five (right) ten kilometres away, drawn on their true bearings with the distance shortened. The northern station, filled, has been moved 50 mm along its tie and nothing else is wrong. The bar at each station is the expected value of its own test for a displacement along its tie, noise-free. With three stations the three tests read 3.25, 3.22, 3.22: the data say only that the triangle is too large, and any of its corners could have made it so. With five, the moved station reads 4.31 and no other more than 2.44.

Naming the control station that moved takes a fifth

A local survey tied to distant control can tell that a monument has moved, and with three control stations it cannot say which. Each station gives the local lines one number they know well — its distance — and a shift of the whole control uses up two of them, so three stations leave one and four leave two. Five evenly spaced name a station moved five centimetres 83 times in a hundred; three name it 20. Better lines cannot stand in for the missing stations, and every station added also exposes more of the control's own published error.

practice · Reduction
A 900 km circular accuracy at 55° north, projected. Six thousand ground positions drawn from a circular error of 900 kilometres about one place, each projected in Mercator and plotted as a displacement from the projected place. The curve is the nominal 95 per cent ellipse, computed the standard way — the ground covariance sandwiched between the projection's own derivatives. It holds 93.83 per cent of the points, the cloud is measurably longer than it along its own long axis by 5.52 per cent, and it is not symmetric: the third moment along the page's second axis is 0.727 rather than zero.

The error ellipse is not an ellipse

A positional covariance pushed through a projection is the same matrix sandwich that draws an indicatrix. That is a first-order operation on a map with a second derivative, so the propagated distribution is not the ellipse the sandwich draws — and a nominal 95 per cent ellipse holds 93.06 per cent on one projection and 95.63 on another, in opposite directions, from the same input.

distortion · Precision

A week of twilights learns what a sight is worth

One fix cannot tell how good its low sight was, but every residual of every fix is a point on one straight line whose slope is the square of the refraction share, once each is corrected exactly for its own fix's geometry. After one twilight the estimate is zero four times in ten; after a week it is within half again of the truth nearly four times in five. And the lesson is worth little: a guess within a factor of two already costs under 4 per cent of the fix, a week's estimate 1.3, and a share that changes from night to night by half again costs more than the learning buys.

paths · Position fix

Honest about its control, the test needs eight centimetres where it needed five

A test that holds the control exact reads the control's published error as movement, and at five stations flags a good survey sixteen times in a hundred. Carry the published covariance into the adjustment and the false alarms fall to half a per cent — and the smallest move the test can find grows from 48 millimetres to 77. A five-centimetre move is then named 29 times in a hundred instead of 63, the naming rate of perfect control takes twenty-four stations, and above ten centimetres the two tests agree. What the honest test buys is a flag that means what it says.

practice · Reduction

One survey cannot tell an optimistic report from a moved mark

A local survey that carries its control's published covariance can estimate, from its own residuals, how far that covariance understates the truth. With five control stations the estimate has a standard deviation of 3.8 times the published scale, and a single monument moved five centimetres adds about as much again — four times what a report twice too optimistic would add. Run at the scale it estimated for itself, the honest test stops flooding good surveys with alarms, and names a moved mark seven times in a hundred instead of twenty-five: the move inflates the estimate and the estimate absorbs the move. The report can be checked only across surveys, and telling one twice too optimistic from an honest one takes about two hundred of them with five stations each, or fifty with twelve.

practice · Reduction

The parameters are not independent

Rung seven gives the seven parameters their own uncertainty and stops at seven numbers. There are twenty-eight, and the twenty-one nobody publishes are not small: a translation and the rotation that mimics it correlate at 0.94, the normal matrix has a condition number of 4 × 10¹⁶, and propagating from the diagonal alone overstates the transformation's uncertainty by up to a factor of thirty-six.

datums · Datum

An agency can map where its published covariance is optimistic

The local surveys tied to a regional network each estimate, badly, how far the network's published covariance understates the truth, and the agency that receives them can pool what they say. When the understatement is confined to one part of the region, pooling it into one number dilutes it: a patch covering 15 per cent of the region with errors four times their published size reads as 1.30 for the whole. Counted place by place, the same surveys find the patch — two agencies in three find it with 400 surveys and nearly every one with 800, flagging almost nothing outside it. Fed back as one number the scale removes little of the false alarms inside the patch and costs nearly a third of the test's power outside; fed back as a map it cuts the false alarms inside from 20 per cent to 3 and costs little outside.

practice · Reduction

A choropleth is read by area

Every cartography course states the rule — use an equal-area projection for a thematic map — and states it as advice. It is a theorem, and it has a residual: the error a page puts into a reading is exactly the covariance of the value with the areal factor, which is 24.85 per cent for a northern concentration read off Mercator and 0.00 per cent for the same field read off a map that spreads area by 7.7 to one.

distortion · Thematic

The sample was drawn on the page

Every mean in this collection integrates over the sphere, because that is where the ground is. A raster, a pixel loop and any figure that walks its own canvas integrate over the page instead, and the difference is exactly the covariance between the quantity being measured and the map's own area distortion — 7.2° of mean angular deformation on Miller becoming 18.0°.

distortion · Sampling

Named alongside it

The objects these essays reach for when they reach for this one.

Least-squaresVerificationError ellipseAdjustmentPrecisionRedundancyControl pointsDegrees of freedomEstimatorNetworkWeightingDatum

All concepts