Measuring distortion

The fourth number the ellipse does not carry

A Jacobian has four independent entries and an indicatrix reports three. The missing one is the rigid rotation in the polar decomposition A = R·S, the indicatrix is exactly S, and R is what turns north into grid north: for the transverse Mercator it agrees with the survey formula for convergence to 5 × 10⁻¹⁰ degrees, from a different library and a different derivative.

Assumes The ellipses are a sample, drawn at a size somebody chose.

Nine rungs of this ladder have taken the indicatrix apart as an instrument — what it measures, what it is a limit of, where it fails to exist, how it is drawn, how it is sampled. Not one of them has asked the simplest structural question about it.

A Jacobian has four independent entries. An indicatrix reports three.

Two principal scale factors and one orientation. That is a complete description of a symmetric matrix, and the map from the ground frame to the page is not symmetric.

Two maps with the same ellipses. Mollweide, and the same projection with the sheet turned 37° on the desk. Every ellipse is the same size and the same shape as its counterpart, and its angle to its own graticule is the same — the two indicatrix fields agree to 1.8e-12, which is arithmetic noise. The rotation differs by 37° at every point. So the classical description of a map's distortion is exactly blind to the difference between these two, and the difference is the whole of what a surveyor calls convergence.
Fig. 1 Mollweide, and the same projection with the sheet turned 37° on the desk. Every ellipse is the same size and shape as its counterpart, and at the same angle to its own graticule: the two indicatrix fields agree to 1.8 × 10⁻¹². The maps are different, and the difference is the number this rung is about.

The split

Every 2 × 2 matrix with positive determinant factors uniquely as

A=R(γ)S,A = R(\gamma)\,S,

with RR a rotation and SS symmetric and positive-definite. That is the polar decomposition, and applying it to the map from the local ground frame — one metre east, one metre north — to the page separates the two things a projection does at a point: it turns the frame, and then it stretches it.

SS is the stretch. Its eigenvalues are the two principal scale factors and its eigenvectors are the principal directions, which is to say: the indicatrix is SS. Not a summary of it, not a projection of it — it is the same object drawn as an ellipse.

That identification is checked rather than asserted. For six projections at six points, RSR\cdot S reconstructs the Jacobian to a residual of 101610^{-16}, and SS’s eigenvalues agree to seven figures with the aa and bb that the classical route through h, k and θ produces from entirely different arithmetic.

RR is the rest. One number, and nothing in the classical description carries it.

It is worth being clear that RR is not a residual or an error term. The decomposition is exact and unique, the two factors are independent, and a projection with a large rotation is not thereby a worse projection — a map that turned every frame through ninety degrees and stretched nothing would be a perfectly faithful map printed sideways. What RR is, is the part of the derivative that a description built to be independent of the page cannot see.

Which rotation

There is more than one angle that could reasonably be called “the rotation”, and they are not the same. That is worth separating carefully, because the fact that they coincide in the case everybody thinks about is why nobody has had to.

The polar rotation γ\gamma is the honest fourth number: the rigid turn in A=RSA = R S.

The convergence is where the image of north points on the page, which is the angle a surveyor applies to turn a grid bearing into an azimuth.

And the image of east points somewhere too, and on a sheared map that somewhere is not perpendicular to the image of north.

For a conformal projection AA is a scalar times a rotation, so the stretch is isotropic, it turns nothing, and all three angles are the same. Off conformality the stretch turns the two axes by different amounts and they separate.

How far the two rotations sit apart. At 35° east, 40° north: the difference between the polar-decomposition rotation and the direction of the image of north, for twelve projections. The three conformal members return exactly zero, to fifteen decimal places, because a conformal Jacobian is a scalar times a rotation and there is nothing for the stretch to turn. The others separate by up to 10.33°, and the separation tracks the anisotropy rather than the areal error.
Fig. 2 At 35° east, 40° north: how far the polar rotation sits from the direction of the image of north, for twelve projections. The three conformal members return exactly zero to fifteen decimal places. The others separate by up to 10.33°, and the separation tracks the anisotropy rather than the areal error.
The worst the two rotations disagree, anywhere. The largest separation between the polar rotation and the image of north over a sample of the whole sphere, for eleven projections. Eckert IV reaches 54.5°, which is not a correction anybody could absorb. Three return exactly zero, for two different reasons: the conformal one because its Jacobian is a scalar times a rotation, and the others because their principal directions lie along the graticule everywhere, so the frame is stretched but never sheared.
Fig. 3 The worst separation anywhere on a sample of the whole sphere. Eckert IV reaches 54.5° — not a correction anybody could absorb. Three projections return exactly zero, for two different reasons.

The zeros in that second figure are the control and they come in two kinds. Mercator’s is conformality. The plate carrée’s and the Miller’s are something else: their principal directions lie along the meridian and the parallel everywhere, so the frame is stretched but never sheared, and a stretch along the frame’s own axes turns nothing. Neither reason has anything to do with the map being good, which is the usual shape of a zero in this collection.

The fourth number has a name already

The fourth number is the grid convergence. The polar decomposition's rotation for the transverse Mercator, and the grid convergence computed by the survey formula in a different library from a different derivative, at three longitudes from the central meridian. They agree to 5.4e-10 degrees everywhere on the plot — the two curves are one curve. The number a surveyor applies to turn a grid bearing into an azimuth is the rotation the indicatrix discards, and nothing in this collection had compared them.
Fig. 4 The polar rotation of the transverse Mercator, and the grid convergence computed by the survey formula in a different library from a different derivative, at three longitudes from the central meridian. The two curves are one curve: they agree to 5 × 10⁻¹⁰ degrees everywhere on the plot.

The transverse Mercator is conformal, so its three angles coincide, and it is the projection every national grid is built on. Its rotation is therefore exactly the quantity grid north is not north is about — the meridian convergence, γΔλsinφ\gamma \approx \Delta\lambda\sin\varphi to first order, printed in the margin of every topographic sheet and applied by every surveyor setting out a bearing.

That check crosses two libraries that share no arithmetic. projection.js differentiates a spherical transverse Mercator numerically and decomposes the result; ellipsoid.js computes the convergence from the survey formula with its own transverse Mercator series. They agree to 5 × 10⁻¹⁰ degrees, which is two nanoseconds of arc and is the numerical differentiation’s own floor.

So the number the indicatrix discards is the one a surveyor cannot work without, and the collection had computed both for a hundred and ninety essays without ever comparing them.

What it does to the instrument

The two rotations, drawn. At each of the sampled points on Eckert IV, two short lines: the direction the polar decomposition's rotation carries the ground frame to, and the direction the image of north actually points. They are the same line on a conformal projection and they are not the same line here — they separate by up to 36.8° across this sample, because the stretch turns the two axes by different amounts. A field of drawn ellipses is identical whichever of them is used, because it carries neither.
Fig. 5 At each sampled point on Eckert IV, two short lines: where the polar rotation carries the frame, and where the image of north actually points. On a conformal projection these are one line. Here they separate by up to 47° across the sample.

The consequence for the indicatrix as an instrument is the one the previous rung was building toward, and it is a fourth unstated choice on top of that rung’s two.

A drawn indicatrix field carries the sizes and the orientations of the ellipses. It carries no arrows, so it does not say which way north went, and there is nothing in the picture from which a reader could recover it. Two maps whose ellipse fields are identical to twelve decimal places can differ by 37° in what they do to a bearing — the hero figure is that pair — and a reader comparing the two fields would call them the same map.

That is not an argument that the indicatrix should be replaced. It is a much narrower claim: the indicatrix is a complete description of what a projection does to shapes and an incomplete description of what it does to directions, and the two are routinely conflated because a shape has an orientation and it is easy to think that is the same thing. It is not: whether the ellipses point the same way measures the orientation of the principal axes, which is inside SS, and none of that rung’s numbers changes when the sheet is turned.

Counting the numbers

It is worth doing the accounting explicitly, because the arithmetic is the argument.

A projection’s derivative at a point is a linear map from a two-dimensional tangent space to the page. In the ground’s own orthonormal frame — east and north, both in metres — that is a 2 × 2 matrix: four numbers.

The classical description supplies:

quantity what it is
aa the larger principal scale
bb the smaller principal scale
θ\theta the ground azimuth of the major axis

Three. Every other quantity this collection computes is a function of those: the areal factor is abab, the angular deformation is 2arcsinaba+b2\arcsin\frac{a-b}{a+b}, the Airy and Kavrayskiy numbers are averages of functions of aa and bb, and the second derivative is a different tensor entirely.

So the missing number is one, it is a rotation, and it is not recoverable from any of the others — because (a,b,θ)(a, b, \theta) determines SS exactly and SS says nothing about RR.

The one place it is nearly recoverable is worth stating so the claim is not overstated. A projection is a gradient map, so its Jacobian field satisfies an integrability condition, and that condition ties γ\gamma’s derivatives to SS’s. Given the whole indicatrix field over a connected region, γ\gamma is therefore determined up to a single additive constant — which is exactly the constant the turned sheet changes. The field determines the rotation up to the orientation of the page, and no more, which is the precise sense in which the hero figure is the whole of the ambiguity.

What was computed, and how

The polar decomposition is closed form for a 2 × 2 matrix and no iteration is used: ATA\sqrt{A^{\mathsf{T}}A} has the explicit form (C+detCI)/(λ1+λ2)(C + \sqrt{\det C}\,I)/(\sqrt{\lambda_1}+\sqrt{\lambda_2}), and R=AS1R = A S^{-1} follows.

Three assertions carry the rung and they reject in three different directions.

The split must be a split. RSR\cdot S must return AA to 10910^{-9} relative, and SS’s eigenvalues must be the classical aa and bb. A sign error anywhere in the decomposition breaks the first; a confusion between AA and ATA^{\mathsf{T}} breaks the second while leaving the first intact, which is why both are needed.

The rotations must agree exactly when the map is conformal and separate when it is not. Three conformal projections must return a gap below 10610^{-6} degrees and some non-conformal one must exceed half a degree. A version that had computed the same angle twice would pass the first half and fail the second.

And turning the page must move RR and not SS. Composing a fixed 37° rotation onto a projection’s output changes the rotation by exactly 37° at every point and leaves the indicatrix identical to 2.5×10122.5\times10^{-12}. That is the exhibit, stated as a check, and a decomposition that had leaked the rotation into the stretch would fail it.

What it changes about reading a distortion figure

Three practical consequences, and the third is the one that matters for how this collection draws things.

A field of ellipses cannot be used to plot a bearing. It says how a small shape is deformed and it does not say which way anything ends up pointing. That sounds obvious stated baldly and is not obvious when looking at a picture, because an ellipse has an axis and an axis looks like a direction.

Two projections whose indicatrix fields differ only slightly can differ enormously in convergence. Two projections that cannot be told apart is about a different kind of indistinguishability — two maps that put the control points in the same places — and this is a third kind: identical deformation and different orientation. A comparison made on distortion alone will not separate them, and a survey will.

And a projection can be improved on one measure by turning it. Nothing about a page rotation changes any distortion figure in this collection, so an aspect search that scores by any of them cannot see it — which is exactly the finding measure.js records when it says that the third aspect parameter is stationary at some optima and not others. The reason is here: the third parameter turns the page, page rotations live entirely in RR, and every criterion in the search is a function of SS. Where the third parameter does matter, it is doing something other than turning the page.

Where the model stops

A page rotation is a trivial exhibit and it is deliberately so. Nobody is confused about whether a turned sheet is a different map; the exhibit’s job is to isolate the fourth number, not to be surprising. The non-trivial content is that γ\gamma and the convergence separate by tens of degrees on ordinary projections, and that the classical description carries neither.

The rotation is not an invariant. It depends on the page’s own orientation, exactly as the exhibit shows, so it is not the kind of quantity what survives a change of coordinates admits. Its variation over a map is invariant, which is why the convergence between two points is a real quantity while the convergence at one point is a convention about where the grid’s north is.

And a rotation is not a distortion. A map that turned every frame by ninety degrees and stretched nothing would be a perfectly faithful map printed sideways. That is precisely why the indicatrix discards it and why doing so was the right decision for the question Tissot was asking. It is the wrong decision for the question a surveyor asks, and this collection has been printing indicatrix fields on pages that also discuss convergence without noticing that the first has nothing to say about the second.

The generalisation

The rule is about the difference between describing a map and describing what it does.

An invariant description throws things away on purpose, and the things it throws away are somebody’s subject. The indicatrix is invariant under a change of the page’s coordinates, and it achieves that by discarding the one part of the Jacobian that a change of page coordinates moves. That is the correct construction for comparing projections and it is the wrong construction for using one.

This collection has met the same structure before from the other side. Only the invariants describe the map is the rule that made h and k second-class quantities here, because they depend on the parameterisation of the sphere; the rotation is second-class for the mirror reason, because it depends on the parameterisation of the page. Both are still measurements. A quantity being a convention does not make it unmeasurable, and the whole practice of survey is the arithmetic of conventions.

The practical form is one sentence: a description that is invariant under a group has nothing to say about anything the group moves, and if somebody has to work in a fixed frame then the group is exactly what they cannot ignore.

Who found it, and when

The polar decomposition is standard linear algebra and its use in continuum mechanics — where RR is the rigid rotation of a deformed body and SS is the stretch tensor — is a century old. The identification of Tissot’s indicatrix with the right stretch tensor is made explicitly in the differential-geometry treatments of cartography and is not made at all in the applied ones.

Tissot published the indicatrix in 1881 and constructed it as the image of an infinitesimal circle, which is a construction that cannot see a rotation: a circle is invariant under one. The construction and the omission are the same fact.

Meridian convergence is older than the indicatrix and belongs to a different literature. It appears in survey manuals, in grid specifications and in the margin diagram of every topographic sheet, and it appears in no treatment of map distortion whatsoever — because distortion is measured by the indicatrix, and the indicatrix does not contain it. The two quantities have been in separate chapters since before either was named, and this rung is the arithmetic that puts them in the same one.

Which uses need the fourth number

The two literatures have been separate since before either quantity was named, and the split is not arbitrary. It follows exactly the split between what a map is looked at for and what it is used for.

Every use that compares shapes needs the three the indicatrix carries. Is this country drawn too large, is this shape stretched, is this angle between two coastlines right — all of them are questions about the stretch, and a rotation of the whole neighbourhood changes none of them. That is the whole of the distortion literature’s subject, and the indicatrix is complete for it.

Every use that carries a direction needs the fourth. A bearing taken off the sheet, a heading plotted with a protractor, a grid azimuth reduced to a geodetic one, an alignment set out on the ground: each of them relates a direction on the page to a direction on the Earth, and that relation is precisely the rotation the indicatrix discards.

Which is why the quantity lives in the survey manuals. Surveying and navigation are the two trades that use a map to point at something, and both of them discovered the rotation independently, gave it a name, printed it in the margin, and built corrections around it. The distortion literature never needed it because it never pointed at anything.

So the omission is a feature of the instrument rather than a mistake in it, and the correct statement is narrower than the indicatrix is incomplete. It is complete for the class of questions it was built for. It is silent on a second class, that class has its own century-old apparatus, and the two have never been written down as parts of one four-number description — which is what this rung does and is the whole of what it does.

Where the ladder goes next

Ten rungs have audited the indicatrix as an object, as a picture, as a sampled field and now as a decomposition. What remains untouched is the assumption underneath all of them: that the thing being differentiated is a map of a fixed body. The ground has an indicatrix too, and the ground moves — so at any place with a strain rate there are two tensors and one page, and whether their principal directions have anything to do with each other is a question neither anchor has asked.

What this makes readable

Essays that name this one as a prerequisite.

Named alongside this one

Essays reaching for the same objects. Nobody chose these; they are what the concept index makes visible.

What links here

Every essay whose body links to this one.

The objects this essay names

Each one links to every other essay that touches it.

AnisotropyClosed formConformalityConvergenceGrid northInvariantJacobianPrincipal scale factorsRealisationTissot's indicatrixTransverse MercatorVerification