A Practitioner’s Guide to Building, Validating and Defending a Credit Model That Decides
Julian R. Sterling
These are the four Excel workbooks that go with the book. Every figure the book prints is
reproduced in them by a live formula rather than a typed constant — move a bin boundary,
change the loss given default, drag the cut-off, and every dependent number moves. Each one ends
with a Checks sheet setting the printed figure beside the computed one:
140 controls in all, every one green. If a control ever reads FAIL, the workbook
is wrong, not the book.
Free to download. No sign-up, no email address, nothing to fill in.
Everything described below is inside it, with the read-me.
The four workbooks
Chapters 1 to 6
The card, built from counts
Eight thousand four hundred applications as a filterable table, and the whole scorecard built
on top of them from nothing but counts. Bin tables for all seven characteristics, the weight
of evidence as the logarithm of the ratio of good share to bad share, the contribution of
every bin to the information value, and the information value as a column total.
The eighth characteristic is there too, the one that cannot be used: days past due at month
three, with an information value of 2.8606 against 0.2471
for the best usable field on the extract. Put it into the model and the area under the curve
goes from 0.7353 to 0.9125. It is measured three months after the money is
lent. The points table then derives its own factor and offset from twenty points to double
the odds and six hundred points at fifty to one — 28.8539 and
487.1229 — rather than taking them as given.
The_Card.xlsx · XLSX · 261 KB
Chapters 7 to 10
Ranking, and then level
The score is rebuilt row by row from the points table by lookup, not carried, and reconciled
against the reference model to seven decimals. On top of it: the ten development bands, the
area under the curve by ranks — 0.735329 — Gini at 0.470659, and
KS at 0.341154 with its exact location on the scale.
Then the distinction the book is built on. Out of time the ranking barely moves, to
0.718513. The level moves a great deal: the card under-predicts the bad rate
in nine bands out of ten, by 9.612 percentage points in the worst. The sheet
solves the single-parameter fix on the page — an intercept shift of 0.573620 in
log-odds, which is 16.55 points — and shows what it does and does not
repair.
The out-of-time distribution laid on the fixed development boundaries, which
is the only way to see a population move: recompute the deciles on the new population and you
erase exactly what you were trying to measure. Every population stability index term appears
as its own row — share difference times the logarithm of the share ratio — summing
to 0.090517, with the top band alone contributing 0.029335 as it falls from
10.00 per cent of the book to 5.33.
Then the sample nobody quotes. Through the door the applications run at 8.1190 per
cent bad; the accepted book runs at 5.2224 per cent and the declined at
12.7554 per cent. The sheet rebuilds the split from the four hand-written
policy rules and reconciles it to 682 bad cases, so you can watch a model's measured accuracy
change with nothing but the population it is measured on.
Stability_and_the_Door.xlsx · XLSX · 311 KB
Chapters 13 to 15
The number that actually decides
The unit economics derived on the sheet rather than asserted: 185,000 of exposure at 4.12 per
cent of margin less 640 of cost gives 6,982 for a loan that performs; 41.7
per cent of loss plus the same 640 gives minus 77,785 for one that does not; the swing is
84,767 and the break-even bad rate is 8.2367 per cent.
Both profit grids run live from 480 to 640 points. On the development book the peak is at
550 points, approving 83.50 per cent and earning
17,348,284; at 600, the score a nervous committee reaches for, the same book
earns 5,596,817. Switch the grid to 2020 and 2021 and the peak has moved thirty points, to
580: a policy left at 550 turns 2,563,882 into a loss of
149,416. The last sheet sets the card against a hundred and eighty boosted
trees at equal approval rates, in both years.
The_Cut_Off.xlsx · XLSX · 339 KB
Conventions used throughout
Blue text
a hardcoded input — you may edit these
Yellow fill
an input cell; everything else on the sheet is a formula
Black text
a formula — do not overtype these
Checks sheet
the printed figure beside the computed one, with a PASS or a FAIL
Why the checks matter more than the models
A workbook that agrees with a book proves nothing on its own — the author wrote both. What
the Checks sheets do is different: they force the model to reproduce, from a formula, a number
that was printed before the model existed.
Two quantities are carried as data rather than recomputed, and both are flagged as inputs on the
page itself. The eight fitted regression coefficients, because a logistic regression cannot be
fitted in a spreadsheet. And the boosted-tree score on every row, because an ensemble of a
hundred and eighty trees cannot be rebuilt in one either. Everything downstream of them —
their area under the curve, their bands, their profit at every approval rate — is computed
by the same live formulas as the card's, so the comparison is like for like.
Where two correct computations disagree, both are printed. The rank-sliced deciles put exactly
600 cases in every band; the fixed-boundary bands, which calibration and the stability index
require, put 600, 599, 601, 600, 600, 598, 602, 600, 600 and 600, because scores repeat and ties
have to fall on one side. Two non-bad cases move. Neither table is wrong and the gap is not
smoothed away.
Opening the files
The workbooks open in Microsoft Excel, LibreOffice Calc, Google Sheets and Numbers. They use
no macros and no add-ins, so nothing needs to be enabled or trusted. If your spreadsheet asks
to update links on opening, decline — there are none.
Closing the DealTwo defensible bridges 20.70 million apart, a peg worth 7.00 million, and the six choices that remove 6.60 of a 12.00 earn-out.
CMBS and CRE CLOsWhere the loss actually lands, from appraisal reduction to realised severity, and what the B-piece is really being paid for.
How to Read a Commercial LeaseThe three refinements chapter 19 names and never performs, and the renewal rate below which the mark-to-market is worth nothing.
How to Read a Credit AgreementWhere the default actually comes from, the cure that costs 5.5 times the other, and the capacity nobody adds up.
How to Read a Real Estate Loan AgreementThe cure ratio in closed form, the four-point window in which the cheap cure works, and the cure sized to the wrong threshold.
Office Real EstateA six per cent yield that returns 3.2 per cent once the re-letting cycle is paid for, and the headline-to-net-effective rent arithmetic.
Private Equity Real EstateBoth worked waterfalls to the dollar, the two capital stacks, and the arithmetic of the promote made changeable.
Private Markets PerformanceThirty-one of the thirty-three figures chapter 19 publishes reproduce exactly — and the two that do not are named rather than quietly adopted.
Raising a Real Estate FundThe chapter 17 funnel run on a calendar — when the first close actually lands, and why more travel does not help.
Real Estate FinanceFour people look at one building and reach four numbers; the lender is whole only above 105,109,489, twelve per cent below today’s value rather than forty.
Real Estate Financial ModelingProperty, development and fund models built line by line, and the modelling test worked end to end.
Real Estate Fund ManagementThe waterfall of 6.11, the build-to-core of 8.7 and the proceeds gap, reproduced as live formulas rather than asserted.
REIT Analysis and ValuationFFO of 532.0, AFFO of 381.0, net asset value and dividend safety — every figure a formula you can change.
Retail Real EstateThe occupancy cost of every unit in a centre, the sixteen per cent of the rent roll no tenant can sustain, and the right-size-convert-or-hold decision priced.
Sale and LeasebackA €179.5 million transaction end to end, with rent cover measured on the entity that actually signs the lease.
Self-Storage Real EstateThe cohort engine behind a 590-unit store, and the rate increase on existing customers priced against the move-outs it causes.
The Fund Finance ProfessionalChapter 8 builds the reported-to-eligible NAV bridge; chapter 9 computes every ratio without it. Two points at every state — and what a subscription line does to the IRR.
The Growth Equity InvestorWhat a pro rata cheque really costs, and the band where defending your ownership loses money.
The Private Credit InvestorThe two coverage ratios are not measured on the same thing: the erosion is 47.7 per cent, not the 28.7 the headline implies.
The Private Equity Fund Controller PlaybookThe book defines IRR, DPI, RVPI and TVPI, tells you to update them at the exit, and prints not one value. Computed: a 1.833× deal inside a fund at 0.892 TVPI.
The Venture Capital AssociateWhat defending a position costs, and how many companies a reserve pool actually defends.
Financial Risk ManagementA fund inside every limit that cannot meet a redemption — and the number that decides it is the one with no currency attached.
Business ValuationThree advisers land 26.8 per cent apart on one company, and the whole gap turns out to be 1.96 points of perpetual growth.
Quantitative FinanceThree models agree to a quarter of one per cent about a number that one unobservable input moves a hundred and three times as much.
Asset ManagementFour people quote four returns for one mandate, all correct and 2.7017 points apart — forty-eight times the manager’s net skill.
Alternative InvestmentsA manager reports 13.29 per cent and the endowment earns 6.26 — both correct, and only a third of the advertised advantage arrives.
Credit AnalysisFour defensible EBITDAs on one borrower give leverage from 3.19x to 6.47x — and the add-back argument is fifty times the covenant headroom.
Venture CapitalOne company out of twenty-eight returns 56.7 per cent of the fund, and half the capital goes in after the decision — at half the return.
Commercial Real Estate InvestingThe equity earned 8.6647 per cent and the investor received exactly 8.0000 — the preferred return, and nothing above it.
Mergers and AcquisitionsThe board paper says the deal creates 13,436,667 of value. The arithmetic says it destroys 17,530,855. Nobody is lying.
DerivativesThe treasury report says the hedge cost 1,233,698. That is the interest differential, not a cost.
Treasury ManagementFive cash balances for one company, all correct and 145,600,000 apart — and the revolver that is two-thirds of the liquidity leaves at a revenue fall of 8.4127 per cent.
Financial Planning and AnalysisRevenue 3.0190 per cent above budget and operating profit 16.3209 per cent below it, in the same quarter, with every figure correctly stated.
Energy TradingA position report that is 91.7031 per cent hedged and correctly computed, on a book that is short 2,542,000 MWh — and a margin call of 198,400,000 the next morning.
Construction Cost ControlA contract sum of 26,301,102 became a final account of 29,153,363 on the building that was drawn — and 85.8 per cent of what was lost was knowable on the day it was signed.