Concept

Bias — where it appears

A systematic error whose expectation is not zero, so that averaging over more measurements does not reduce it. It is the distinction that decides whether an aggregate is safer than one of its terms: a noise divides by the square root of the count and a bias divides by nothing.

Named by 10 essays across 2 fields — each of them below, with the objects they name alongside it.

10,000 observations of one place, averaged 120 times. Left: 400 single observations of the same place, with a 60-kilometre standard deviation east and north, drawn across ±400 km. They are scattered about the truth and their average is unbiased on the ground. Right: 120 independent averages of 10,000 such observations each, computed on the page and taken back to the ground, drawn across ±1.8 km. The cloud is tight, as averaging ten thousand things should make it, and it is not centred on the cross: it sits 489 m away, against 403 m predicted by the projection's second derivative alone.

The average of noisy positions moves

Average sixty thousand scattered observations of one place on a Mercator map and the answer is 404 metres too far north — at every sample size, because it is a bias and not noise. The same average on the Lambert cylindrical equal-area is 404 metres too far south, the two being ½ (σ²/R) tan φ and its exact negative, and on the plate carrée it is not displaced at all.

distortion · Precision
Twenty-four versions of one shape, and not one of them gains area. The same closed boundary rotated twenty-four times and simplified at the same tolerance. If the area error were noise the values would straddle zero and their mean would fall towards it; they do not. Every one is negative, the mean is -0.4644 per cent, and the mean is 71 standard errors from zero. A bias of that size cannot be removed by averaging over more boundaries, which is the only defence anybody has against a rounding error.

A thousand features are wrong in the same direction

The area a simplification costs is unpredictable in sign for one feature. Over a population it is not: twenty-four presentations of one shape all lose area, the mean is seventy standard errors below zero, and no amount of aggregation removes it.

applied · Generalise
Three selection rules, and what each one keeps. Keeping one feature in ten from a stated population whose size distribution has a Pareto exponent of a half — the exponent Töpfer's law is a theorem about. Keeping the largest carries 99.99 per cent of the total size and inflates the median feature by a factor of 95. A random sample keeps the median to 1.068 and carries 5.0 per cent of the total. The two rules are right about different things and there is no rule that is right about both, because the total lives in the tail and the median does not.

Which features survive is not a sample

The rung below answers how many features a scale can carry and treats the population as a number. Which ones survive is a different question: keeping one feature in ten carries 99.99 per cent of the total length and inflates the median feature by a factor of 95, and the shape of the size distribution survives both exactly.

applied · Generalise
The bias is σ² over the length, over two decades. The amount by which a measured baseline is longer than the true one, against its length, for a twenty-millimetre error on each end. The line is the second-order prediction σ²/d. The measured bias times the length is constant to a factor of 1.0014 across the whole range, and it sits 8.2 per cent below the prediction — which is the fourth-order term the expansion drops. The estimate is antithetic, so the first-order scatter cancels exactly and a bias of thirty-seven microns is measured at a t-statistic of 349.

A length measured from noisy points is too long

A distance is a square root, a square root is concave, and the average of the distances is not the distance between the averages. The gap is a bias with one sign: 37 microns on a ten-metre baseline with twenty-millimetre marks, following σ² over the length across two decades, and it adds rather than cancelling — so the same boundary is 1.5 parts per million longer when it is measured in more pieces.

distortion · Precision
The same field, the same statistic, two pages. A single northern concentration — v = 10 + 90 exp(−d²/(25°)²), d the distance from 20°E 55°N — drawn twice, with the shading rule and the data identical. The ground's own area-weighted mean is 14.009. A reader weighting by the area actually on the page takes 17.490 off Mercator, which is +24.85%, and 14.009 off Gall–Peters, which is +0.00%. Neither map has misdrawn a single cell.

A choropleth is read by area

Every cartography course states the rule — use an equal-area projection for a thematic map — and states it as advice. It is a theorem, and it has a residual: the error a page puts into a reading is exactly the covariance of the value with the areal factor, which is 24.85 per cent for a northern concentration read off Mercator and 0.00 per cent for the same field read off a map that spreads area by 7.7 to one.

distortion · Thematic
The same count, scattered two ways. 22 dots in every cell of a 30-cell covering, drawn on Mercator. The upper panel places them uniformly on the GROUND — uniform in longitude and in the sine of latitude, which is what uniform on a sphere means — and the lower places them uniformly on the PAGE, which is what a drawing routine handed a polygon does. Both panels carry exactly the same number of dots in exactly the same regions, so both are honest as totals. They are different pictures, and a reader reads a dot map by density.

A dot map's density is partly the projection's

A dot map carries the right number of dots in every region whichever way it is drawn, so it is honest as a total under both placements. It cannot be honest as a density under both: ground on a uniform field reads 0.099 of its equatorial density at 72° north on Mercator, and scattering inside the polygon on the page moves 64.3 per cent of a cell's dots into its northern half without one of them leaving the cell.

distortion · Thematic
One field, one classifier, two sets of breaks. A field that varies with latitude put into 5 classes by area-weighted quantiles, on Mercator. The upper panel weights each region by its ground area and the lower by the area it occupies on this page, which is what a classifier handed projected geometry does. 60 of 150 regions land in a different class, marked in the lower panel. The data has not changed and neither has the number of classes.

The class breaks were computed on the page

The three rungs below price what a reader does with a finished map. A classifier is software, it runs on the geometry it has, and the geometry it has is projected: a five-class quantile classification of one stated field puts half of the three hundred and eighty-four regions in a different colour on Mercator, and 87.5 per cent of them at nine classes.

distortion · Thematic
Densifying helps one and hurts the other. The standard deviation of the shoelace area, and the bias of the perimeter, against the number of vertices on the same 100-metre circle with the same 5-centimetre noise on each. The area's spread falls from 9.9 m² to 2.0 — the closed form says it goes as the square root of the vertex count's reciprocal, because a vertex's influence on the area is the vector between its two neighbours and densifying shortens it. The perimeter's bias rises from 0.07 mm to 261, a factor of 3697, because every leg contributes its own σ²/d and shorter legs contribute more.

The area is unbiased and the perimeter is not

A boundary measured from noisy vertices comes out long, always, by σ²/d on every leg. The area enclosed by the same vertices comes out exactly right, because a shoelace is bilinear and the cross terms vanish. So densifying a boundary makes its area five times more precise and its perimeter three thousand times more wrong, and every compactness score computed from it falls short.

distortion · Precision
One map, two samples, two answers. The same Miller cylindrical projection carrying two sets of sample points of the same size. On the left the points are uniform over the SPHERE — equal ground area between them, which is what every mean in this collection integrates against. On the right they are uniform over the PAGE, which is what a raster, a pixel loop or any figure that walks its own canvas produces. The right-hand set crowds where the map stretches, and the mean angular deformation it returns is 18.0° against the left-hand set's 7.2°.

The sample was drawn on the page

Every mean in this collection integrates over the sphere, because that is where the ground is. A raster, a pixel loop and any figure that walks its own canvas integrate over the page instead, and the difference is exactly the covariance between the quantity being measured and the map's own area distortion — 7.2° of mean angular deformation on Miller becoming 18.0°.

distortion · Sampling
Two places, one written coordinate. The lattice a coordinate written to 5 decimal places lives on, at 45° of latitude, where a cell is 1.11 metres north to south. Two real places a fifth of a cell apart are drawn as open marks and the single value they both round to as a filled one. The distance between them, computed from what was written, is exactly zero — an error a noise model cannot produce, since independent noise never puts two different points in the same place.

Rounding is not noise

Eight rungs treat a coordinate's error as noise that averages down. A published coordinate has a second error that does not: it is deterministic, it is shared between every point in the same cell, and at five centimetres apart ninety-three per cent of pairs come out as the same place — which no amount of independent noise can produce.

distortion · Precision

Named alongside it

The objects these essays reach for when they reach for this one.

Equal-areaArea weightingAreal factorPrecisionThematic mappingToleranceVerificationAggregationClosed formCovarianceDensityGeneralisation

All concepts