Institutional Analysis

I Stopped Believing the Quarterly Averages Told the Truth

Why the most dangerous errors are the ones where the numbers are mathematically correct, yet communicate nothing.

I walked into a glass door yesterday. It wasn’t a metaphorical barrier or a glass ceiling; it was a very real, very thick pane of industrial-grade silica that had been polished to such a high sheen it ceased to exist to the naked eye. I was looking at the reflection of the hallway behind me, convinced I was seeing the path forward, and the resulting crunch of my nose against the cold surface was a violent reminder that what we see and what is actually there are often two different things. My face still hurts, a dull throb that reminds me every time I squint that my internal map of the office is flawed.

As an inventory reconciliation specialist, I deal in the debris of these kinds of errors. I spend my days looking at what the system says should be on the shelf versus what is actually sitting there in the dust. Usually, the system is optimistic. It thinks we have 412 units of a specific SKU, but I can only find 380. Where did the other 32 go? They evaporated into the gap between the transaction and the reality.

But lately, I’ve realized that the most dangerous errors aren’t the ones where the numbers are wrong. The most dangerous errors are the ones where the numbers are technically, legally, and mathematically correct, but they communicate absolutely nothing about the state of the room.

The Green-Light Territory Fallacy

I stopped believing that the quarterly averages told the truth about . I was sitting over a reconciliation report for a regional distribution center, and the “Average Shrinkage” was sitting at a comfortable 2.1%. By every institutional metric, that is a success. It’s green-light territory.

But when I looked at the individual line items, the truth was a mess. One specific category-high-end electronics-was hemorrhaging at 15%, while basic hardware was over-stocked by 10%. The average was a lie that protected the failing department and ignored the surplus in the other. It was a mean that meant nothing.

15%

Loss

2.1% Avg

10%

Surplus

A visualization of institutional blindness: A “healthy” 2.1% average created by two unsustainable extremes.

This isn’t just a problem in warehouses. It’s a systemic rot in how we communicate information upward in almost every service-oriented profession. We are obsessed with the aggregate because it’s the only thing that fits into a slide deck. We take the messy, jagged, terrifyingly specific reality of human experience and we sand it down until it’s a smooth, round number that won’t snag on anyone’s sensibilities during a board meeting.

The Interface of the Template

Imagine it’s the end of the quarter. A clinician is sitting at her desk, the light of the afternoon fading, and she has a template open on her screen. This template is the interface between her world-the world of tears, breakthroughs, and agonizingly slow progress-and the “System.” The system has four boxes for her to fill in.

Improvement

72%

Satisfaction

4.6 /5

She fills them in. She is an honest person, so she does the math carefully. Her average satisfaction score is 4.6 out of 5. Her improvement rate is 72%. These are good numbers. They are the kind of numbers that get a “Well done” email from a manager who hasn’t seen a patient in six years. But as she clicks ‘save’ and closes the file, she feels a specific, low-grade discomfort. It’s the feeling of having reported accurately and communicated nothing.

Because in her head, she isn’t thinking about the 72%. She is thinking about the six clients who kept her awake last night. She can name them without checking her notes. She can tell you precisely why each one is struggling, and precisely why they don’t fit into the “Average Improvement” box.

The Faces Behind the Figures

There is the young man with severe OCD whose progress has stalled not because the treatment isn’t working, but because his housing situation collapsed. There is the woman navigating a bereavement so complex that the standard “improvement” metrics feel like an insult to her grief. There is the person whose ADHD is so intertwined with their anxiety that every time they make a step forward in one area, they feel like they are failing in another.

None of this detail survives the journey to the quarterly report. By the time her knowledge reaches the decision-makers, it has been stripped of its context, its nuance, and its utility. It has become a 4.6.

Institutions do not fail to communicate what they know because of a lack of effort; they fail because they communicate in a format that structurally cannot hold the truth. We have built an entire civilization on the idea that if we can just find the right average, we can understand the whole. But you can’t understand a forest by calculating the average height of the trees, especially if half of them are saplings and the other half are ancient oaks.

The reporting layer is incapable of representing the thing the service actually understands. This is the core frustration of the frontline worker. They are the ones holding the detailed, individual, accurate knowledge of who is doing badly and why. They are the ones who know that the “one-size-fits-all” approach is failing the very people it was designed to help. And yet, the only way they are allowed to speak to the institution is through the medium of the spreadsheet.

Breaking the “Meaningless Mean”

In my world of inventory, if a shelf is sagging under the weight of too much stock, the average weight of the warehouse doesn’t matter. The shelf is still going to break. In the world of mental health, if a specific treatment pathway isn’t working for a specific type of person, the average satisfaction of the clinic doesn’t matter. The person is still going to suffer.

This is why the structure of the service itself matters so much more than the reporting of it. If you build a service around “General Counseling,” you are essentially building a service around the average. You are saying, “We treat everyone the same way, and we hope the average turns out okay.”

When I look at the model used by Mind a Porter, I see an attempt to break this cycle. By organizing around condition-specific treatment pathways-over 50 of them, clustered into clinical specialisms-they are acknowledging that the detail is the point.

Depression

Social Anxiety

Complex PTSD

Health Anxiety

+46 more

Specific maps for specific difficulties.

The use of a matching questionnaire is a prime example of this. It’s a tool that routes people by how they actually think and what they are actually experiencing, rather than just the label they might have arrived with. It’s a way of capturing the “frontline knowledge” before the person even enters the room. It’s the opposite of an aggregate report; it’s a tool for radical specificity.

The Price of Institutional Blindness

I’ve spent a lot of time thinking about why we cling to these averages despite knowing how much they hide. I think it’s because the truth is too heavy to carry. If a manager had to actually look at the “six clients” who are worrying the clinician, they would have to feel the weight of those lives. They would have to acknowledge the complexity and the potential for failure. An average of 4.6 is light. You can carry it in your pocket. You can put it in a chart. You can sleep at night believing that everything is fine.

But the price of that comfort is a profound institutional blindness. We end up steering the ship based on a summary that omits the only variables that actually determine where the ship is going. We plan for the “average patient” who doesn’t exist, and then we are surprised when the real patients don’t get better. We manage the inventory of the “average shelf” and then we wonder why the warehouse is a disaster.

There is a deep irony in the way we defend these aggregate reporting systems. We say they protect privacy, which is true to an extent. We say they allow for comparison across departments, which is also true. But we rarely talk about the consequence: the total loss of institutional memory. Once that quarterly report is filed, the specific reasons why those six people were struggling are deleted from the organizational record. They are smoothed over. The “low-grade discomfort” of the clinician is ignored.

Clarity vs. Transparency

I still have a mark on my nose from that glass door. It’s a small, red reminder that transparency isn’t the same as clarity. A glass door is transparent, but if you don’t know it’s there, it will still break your face. A quarterly report is transparent-you can see the numbers, you can see the math-but it doesn’t give you clarity. It doesn’t tell you where the obstacles are.

The next time I have to reconcile a shelf, I’m not going to look at the average. I’m going to look at the outliers. I’m going to look at the things that don’t fit. Because the truth isn’t in the middle of the bell curve; it’s at the edges. It’s in the specific, the jagged, and the uncomfortable.

If we want to build services that actually work, we have to stop reporting in a format that was designed to hide the very things we need to see. We have to start valuing the knowledge of the person in the room over the convenience of the person in the boardroom. Until then, we’re all just walking into glass doors, wondering why the path forward feels so much like a wall.

By