Audit — the series · Cartographic Projection

Every projection in the library, measured against both properties. Maximum angular deformation across the bottom, maximum areal error up the side, both on logarithmic scales and both measured over several hundred sample points rather than taken from the projection's description. Conformal projections lie on the left edge, equal-area ones along the bottom, and the corner where both vanish is empty because a projection there would be an isometry of the sphere onto the plane. All 26 are plotted; the four named here are Mercator, Mercator (ellipsoidal), Web Mercator, Gall–Peters.

Web Mercator is not conformal

It carries almost every map on the internet, it is named after the projection whose entire purpose is preserving angles, and it does not preserve angles. The test that found it was not looking for it.

part 1 · wrong

How much each projection inflates a cell, by latitude. Five patches of the sphere, each 20° by 10°, and the factor by which each projection enlarges them relative to the equatorial one. An equal-area projection sits flat on 1. Mercator reaches 15.4× at 70°, which is the mechanism behind every complaint about the size of Greenland.

Mercator against Peters

The most-argued question in cartography, conducted almost entirely without anyone measuring anything. Both projections are exactly what they claim, each destroys what the other keeps, and the numbers are computable in either direction.

part 2 · wrong

One 20° × 10° cell at 60°, under four projections. The same patch of the sphere, drawn by four projections and scaled to fit. The shapes differ and so do the areas: the figure under each panel is the areal inflation relative to the same cell at the equator, so 1.00 means the projection treats the two fairly.

The projection that shows true size

There is no such thing, and the phrase hides a real question. Equal-area projections preserve area and destroy shape; nothing preserves size in the sense the phrase implies; and the tools that make the point best are not maps at all.

part 2 · wrong

How Equirectangular distorts, by latitude. Angular deformation and areal scale plotted against latitude along the meridian at 0°. On Equirectangular the angular deformation reaches 114.2° and the areal factor reaches 11.5.

The plate carrée, the projection nobody chooses

Plotting latitude against longitude on ordinary axes is a projection. It preserves nothing, its angular deformation reaches 108° and its areal error eightfold, and it is probably the most widely produced map in the world because it is what happens when nobody decides anything.

part 3 · wrong

A triangle of 25.0° excess, drawn on Mercator. The three geodesic sides as curves and the three straight sides a ruler draws, with each vertex labelled by how far the ruler's angle is from the true one. The straight-sided triangle's angles sum to exactly 180° because it lies in a plane, and the real one's sum to 205.02°, so the three errors have to account for the whole 25.02° of spherical excess between them — and they do so on this conformal projection exactly as they do on any other.

Conformal does not mean the angles are right

A conformal projection preserves angles between curves at a point. Draw a triangle on one with a ruler and its angles are wrong by degrees — and the total error is fixed before the projection is chosen, because a plane triangle sums to 180° and the real one does not.

part 4 · wrong

Equal-area on the wrong body

The site's headline is that Web Mercator puts geodetic latitudes into a spherical conformal formula and stops being conformal. The same sentence is true with "equal-area" in it and nobody says it: the areal factor is 1.00674 at the equator, 0.99332 at 88°, and averages to almost exactly one — so every check that adds up areas passes while every cell is wrong.

part 5 · wrong

The taught rule against the measurement, on 30 regions. Each cell is a region built to order — a box of the stated height and width-to-height ratio, centred at the stated latitude — with the family that actually scores best over it, and whether that is what the rule says. Every family is given its own parameters for the region: the conic its cone constant, the cylindrical its standard parallel and the choice of a normal or transverse axis, the azimuthal its centre. The rule is right on 19 of 30, and where it is wrong it is wrong in one direction: it keys on latitude, and what decides the answer is shape.

The rule of thumb, scored

Cylindrical near the equator, conic in the middle latitudes, azimuthal at the poles. It is the most repeated piece of practical advice in cartography and it has never been run against a population of regions. Run against thirty, it is right nineteen times, and every one of its failures has the same shape.

part 6 · wrong

Two rules, three populations. The taught rule keys on latitude; the replacement keys on shape. On the thirty regions the replacement was read from it scores 83 per cent against the taught rule's 63. On forty-five different regions built the same way it scores 91 — higher, not lower, so the generalisation the shortfall doubted is real. On the seven named regions this collection actually uses, both rules score 29 per cent, and following either costs a mean factor of 14.6. The third bar of each group puts the taught rule's polar clause back into the shape rule, which is what the out-of-sample failures ask for: it repairs four of them, breaks two that were right, and reaches 43 of 45.

The rule scored out of sample

A replacement rule was read off thirty regions and scored on the same thirty, and this collection recorded that as not being evidence about any other thirty. It is: on forty-five different regions the rule scores 91 per cent against the 83 it managed at home. What it cannot do is the seven regions the collection actually uses, where both it and the rule it replaced name the winner twice out of seven and cost a mean factor of 14.6.

part 7 · wrong

Every library projection over Europe, on the two axes it can be wrong on. Each dot is one projection, scored over Europe on the two independent failures: how much it turns angles and how much it changes areas. The lower-left corner is the isometry that does not exist. The line joins the five projections nothing beats on both counts — the rest are inside it, and a reader who prefers either failure to the other should still not choose one of them, whatever weighting they hold.

The projections that are beaten on both counts

A rule of thumb has been scored over thirty regions and then forty-five. The same populations answer a harder question nobody has put: which library members are never the right answer at all. Two are beaten outright on both criteria everywhere, one is on no regional front in any population — and it is on the world's.

part 8 · wrong

Every projection's angular deformation, and the tolerance that judges it. The whole library on one logarithmic axis, with the tolerance drawn as a line. The population is bimodal: the projections that satisfy the condition sit at 2.09e-6 and below, the ones that do not at 3.85e-1 and above, and there is nothing between. The tolerance could be moved anywhere in that gap — a factor of 1.84e+5 — without changing one verdict. Larger marks are projections that claim the property.

The tolerance that decides the verdict

Every verdict handed out about a projection's claimed property rests on a tolerance chosen once, long ago, at sixty times a measured noise floor. Swept, it decides nothing: the population is bimodal, the tolerance sits in a gap 238,000 times wide for conformality and 646 million times wide for equal area, and the verdict with the least room is a passing one whose margin is the arithmetic's rather than the map's.

part 9 · wrong

Four of the seven on the front can never be first. Every library projection over the whole sphere, with both errors normalised to the table's own range. The seven filled circles are the Pareto front — nothing beats them on both counts. The line through three of them is the lower convex hull, and a weighted sum of the two errors is a straight line in this space, so only a hull vertex can ever come first. Four projections — Web Mercator, Miller cylindrical, Equirectangular, Winkel tripel — sit in the dents, undominated and unchoosable.

Which projection a weighting can make best

The seven world projections nothing beats on both counts tell a reader with a preference that one of them is their answer. Four of the seven are not: they sit in dents of the front, undominated and unreachable, and no weighting of angle against area can ever put them first. Robinson can be first, on 2.8 per cent of the weight range.

part 10 · wrong

Three projections that run in a circle. Mercator beats Sinusoidal beats Eckert IV beats Mercator, each on a majority of the same seven criteria over the whole sphere. Every margin is four to three, the narrowest a majority of seven can be, and the criteria that decide each edge are different ones. There is no way to place these three in an order that agrees with all three comparisons, and the obstruction is not a measurement error: every number is exact to the precision the sampler reaches.

The ranking is not an order

A weighting can be made to put almost any projection first. Remove the weights entirely, let each of the seven criteria vote once, and the answer is worse: over the whole sphere Mercator beats the sinusoidal, the sinusoidal beats Eckert IV, and Eckert IV beats Mercator — four such circles, every margin four to three, with a Condorcet winner sitting above them all.

part 11 · wrong

One quantity, one region, and the exponent left free. The scale departure of six projections over the world, aggregated as a p-norm, against p on a logarithmic axis. At p = 1 the best is Eckert IV; at p = 64 it is Winkel tripel. Nothing about the maps changed between the two ends of the axis — only how much of the region a bad point is allowed to spoil. Drawn in no projection: the axes are an exponent and a score.

The average was a choice of norm

Ten projections, one region, one measured quantity, and the only free decision left is how to turn a field into a number. Over the world's scale departure the ordering at the mean and the ordering at the worst case have a rank correlation of −0.04, all ten maps change position, and the exponent that produced each answer is stated nowhere.

part 12 · wrong

The area weighting was a readership all along

Twelve measurements have taken a projection comparison apart and found the comparer's own freedom in every part of it. All twelve rested on one thing none of them examined: that a square kilometre of empty ocean counts exactly as much as a square kilometre of city. That is not the absence of an assumption about the reader — it is the assumption that everybody who will ever look at the map is spread evenly over the globe. Named as one readership among five, it produces a different winner from three of the other four, and against a North Atlantic readership its choice is fifth of twenty and 33 per cent worse.

part 13 · wrong

A territory, and two enclosures somebody might score instead. A stated territory at 45° north — an ellipse twenty-eight degrees long and eight wide, its long axis bearing 45° — with its latitude–longitude bounding box and the smallest cap around it, on a globe. The territory fills 40.6 per cent of the box and 28.6 per cent of the cap. Scoring the library over each names a winner: an azimuthal for the territory itself, an azimuthal for its bounding box, an azimuthal for the smallest cap around it. The cost of working from the box rather than the territory, measured as the box's winner scored on the territory against the territory's own winner, is a factor of 1.0584.

The region was a rectangle in a projection

Every verdict this collection hands out is a verdict about a region, and almost every region it has been given is a latitude–longitude box. A box discards a territory's shape, which costs a few per cent, and it records the territory's width in degrees of longitude, which costs up to a factor of 1.72 and changes which family wins on four of forty stated territories. Convert that width to arc and the box gives the right answer every time — so the comparison had a projection in it before it began.

part 14 · wrong