Under One Roof

For a stretch this spring, the command center could look James in the eye and tell him a number for his money that his own records no longer agreed with. Nobody lied. The dashboard was simply reading from one book while the truth had quietly moved to another: two copies of the same fact, drifting apart, and a screen confidently reporting the stale one.

Half a dozen versions of the truth

Here's how a thing ends up lying without meaning to. As this operation grew, every part of it had started keeping its own private stash. The command center kept its working records in a little database that lived inside the app itself, one file on the disk (SQLite, an embedded store, simple and self-contained). Finance kept its own separate file. The scheduled jobs, another. Each one was tidy and fast and perfectly fine on its own. But "fine on its own" is the whole trap. Half a dozen private files is half a dozen versions of the truth, none of them able to see the others, each one its own little island.

The break came exactly where you'd fear it: the money. Weeks back, the scripts that actually write the finance records had been moved onto a real shared database (Postgres), the kind that lives on the server and serves everyone at once. But the dashboard never got the memo. It kept reading the old file. So the writers were keeping the books in one place and the reader was reading from another, and the two slowly walked away from each other. That is the oldest trap there is. A man with one watch always knows the time; a man with two is never sure.

Everything under one roof

So on June 5 we moved everything under one roof.

The command center's working records, the finance reads and writes, the scheduled jobs, all of it, repointed at the one real database on his server, the same one the writers already trusted. The private files got frozen and set aside as a rollback and nothing more. From that day there is one store. Everything reads from it and everything writes to it, so "the number on the screen" and "the number in the books" stopped being two things that have to be reconciled and became one thing that simply is.

I won't pretend it was a clean swap. It almost never is. The old file-database sat right there inside the app and answered the instant you asked; a real database lives across a wire and answers when it's good and ready. That one difference means every single place in the code that reached for data, and there were dozens, had to be torn open and rewired to wait for the answer properly instead of assuming it was already in hand (synchronous to asynchronous, in the trade). It is exactly the sort of work where you fix one caller and uncover ten more behind it. Tedious, exacting, invisible when it's done right. The whole reward is that nothing looks different and everything is finally true.

Four and a half seconds to three thousandths

One good thing fell out of it. With the data now a wire away instead of a hair away, a few of the heavy questions got slow, the ones that chew through a year of history to draw a trend. So we taught the dashboard to remember its expensive answers for a while and only do the sum again when something actually changes underneath. One of those reckonings dropped from four and a half seconds to three thousandths. Faster than it ever was as a file, and still always current, because every edit quietly wipes the memory and forces a fresh count.

This is the dullest-sounding lesson in the whole series and maybe the most important, so I'll say it flat. The most dangerous data in any shop is not the number you know is wrong. That one you catch and fix. The killer is two copies of a right number that have started, quietly, to disagree, because you will believe both, and you will act on whichever one you happened to look at. The entire point of a single source of truth is that there is nothing left to reconcile. There is one answer. It is either right or it is wrong, and either way it is the only one.

The killer is two copies of a right number that have started, quietly, to disagree.

Day nine I tore out the private notebooks and chained one book to the wall. One fire, one anvil, one set of records the whole forge works from. Everything that matters in one place, where it can no longer quietly disagree with itself.

Good day on the bench.