Evidence & data
Methodology
Definitions, calculations and caveats behind the figures used in the book and website.
This book is about a system that produces a great many authoritative-looking numbers. Some of them are genuinely authoritative. Most still require a second question.
The evidence has therefore been handled with the same caution the book asks readers to apply to university forecasts, government announcements and sector averages. A figure may be correctly calculated and still answer a narrower question than the one apparently being asked. A forecast may be reasonable without being an outcome. An aggregate may describe the sector while saying very little about the university nearest to the edge.
Evidential cut-off
The evidential cut-off for the first edition is 14 August 2026. Higher-education policy, immigration rules, fee levels, institutional finances and regulatory interventions continue to change after that date. The historical argument is intended to survive those changes; individual figures and cases will not all remain current. Material published after the cut-off appears in updates rather than being folded silently into the text.
England and the wider United Kingdom
The book concerns UK higher education, but much of its detailed argument concerns England. Tuition-fee limits, student-finance arrangements and the Office for Students belong to the English system. Scotland, Wales and Northern Ireland have different funding and regulatory arrangements, even where institutions share UK-wide data collections, research structures and an international reputation.
Where a source covers only England, the claim is intended to do the same. UK-wide figures are used where the underlying collection genuinely covers the United Kingdom. Treating an English policy as a UK policy can change both the arithmetic and the argument.
Sources and definitions
Primary and official sources have generally been preferred. They are not treated as neutral merely because they are official. Regulatory reports, government impact assessments and sector submissions are produced for different purposes and often use different populations, definitions and time periods. The notes identify those differences where they affect the claim.
University financial data can refer to a financial year, an academic year or a forecast period. Student data may count applicants, entrants, enrolments or full-time equivalents. Research figures may describe cash received, eligible project costs or the wider full economic cost of sustaining the activity. These categories are not interchangeable. The book uses the measure appropriate to the mechanism being explained, and avoids combining unlike measures merely because they arrive with a pound sign.
Inflation and real-terms comparisons
Cash figures are reported in the prices of the year concerned unless the text describes them as real-terms or inflation-adjusted. Where the book cites a published real-terms estimate, it normally follows the source’s stated price base and inflation measure rather than silently recalculating the figure on a different basis. This means two reputable estimates can differ without either being arithmetically wrong.
Real-terms comparisons show changes in purchasing power. They do not imply that every university faced identical costs. Pay, pensions, energy, construction, borrowing and specialist provision do not move in step with a general inflation index. A national deflator can make a comparison intelligible; it cannot turn a diverse sector into one cost structure.
Forecasts, outcomes and revisions
The distinction between forecast and observed outcome matters throughout. Provider forecasts submitted to a regulator are evidence of what institutions expected or planned at the time. They are not evidence that the students arrived, the savings were delivered or the liquidity remained available. Later recruitment data, accounts or regulatory updates are used where they permit the forecast to be compared with what followed.
Some official series are revised after first publication. Reports may also be corrected, superseded or moved to a new web address. Dates in the notes refer to the version used for this edition where that distinction matters. Figures have not been updated merely because a later number exists: an earlier forecast or policy statement sometimes remains the relevant evidence for what a decision-maker knew at the time.
Examples and aggregates
Institutional examples are used to make mechanisms concrete. They should not be read as proof that every university is in the same position. Sector aggregates have the opposite limitation: they can establish scale while concealing the distribution beneath it. The argument uses each for the job it can actually do.
The policy simulator
The policy simulator is a model, not a source. Its own method page sets out every relationship it uses — whether each is an accounting rule, a measured relationship or an assumption, and how strong the evidence is — with its sources, its checks against published figures and its limitations. Changes to the model are recorded there, and every shared link records the model version it was made with.
Corrections
Errors are corrected in public. If you believe a figure, source or characterisation is wrong, please write to justin@obrien.vision — corrections are recorded on the corrections page.