AZIS R. DABAS
Explore
Contact
← Research & evidence

Population health / RESEARCH BRIEF

The target variable is a resource-allocation decision.

A foundational algorithm audit shows why a model can predict spending accurately while directing care-management resources away from people with greater need.

Evidence design: Observational audit of a deployed commercial risk algorithm
Study date: October 25, 2019
This is independent executive analysis of attributed research, not an original clinical study or a peer-reviewed publication.

Editorial revision: . Original publication and source dates are retained.

An integrated sculptural neighborhood of homes, gardens, connecting paths and a care pavilion
Visual essay / Health is shaped by place

Housing, food, mobility and care access belong in the same operating conversation, with distinct owners and measures.

What the research found

Obermeyer, Powers, Vogeli and Mullainathan published their analysis in Science in October 2019. They linked a commercial risk algorithm's predictions with clinical and spending records. At comparable risk scores, Black patients had greater illness burden than White patients. The algorithm predicted future spending, and spending did not represent clinical need equally across these groups. Experiments with alternative prediction targets demonstrated that the choice of target materially affected the disparity. [1]

What the design can establish

This was an audit of an existing system, using patient records from 2013–2015, not a randomized trial of a new care-management program. It identifies a consequential mechanism in the studied setting. It does not establish the present performance of every vendor, prove that one fairness metric is sufficient or measure the health benefit of a redesigned allocation policy. The study is foundational evidence, deliberately dated rather than presented as a recent discovery. [1]

My operator interpretation

I would require the owner of a population-health model to state the decision it is intended to support before discussing predictive performance. Predicting cost, identifying unmet need and estimating benefit from an intervention are different tasks. A budget owner can reasonably need all three, but the organization should not let a convenient claims label quietly decide which people deserve attention.

My proposed review starts with the people whose needs are hard to observe. Limited prior use, interrupted coverage, missing clinical information or difficulty reaching a service should generate questions for the care team. They should not become automatic evidence that support has little value. The alternative is not an unbounded service commitment; it is an explicit policy for assessing need when routine data are incomplete.

I would audit selection and delivery under the actual capacity constraint. If the program can serve only a fixed number of people, changing the score changes who receives an offer and who waits. That is an allocation choice with distributional consequences, even when predictive accuracy improves. The governing team should compare the clinical need and access barriers of both groups, examine the enrollment threshold and preserve an assessment route for people whom the data do not represent well.

Then follow who is contacted, accepts support, receives care and benefits. A revised target can improve selection while language access, staffing or receiving-service capacity still concentrates the benefit among easier-to-serve patients. The investment response may be to change the service rather than retune the model. I would require the committee to explain that trade-off explicitly: which additional need the next unit of capacity can address, which people remain unserved and what evidence supports the choice.

The decision I would make

Before deploying a risk list, I would require clinical review of the target, subgroup evaluation at the actual enrollment threshold and a route for people outside the list to receive assessment. The governing committee should own the tradeoffs and document when the model or service capacity must change. These are my proposed controls, not a validated bundle from the paper.

What this evidence cannot settle

This brief uses explicitly dated foundational evidence. Findings about the studied algorithm should not be attributed to every current product.

Primary sources

  1. Obermeyer et al. Dissecting racial bias in an algorithm used to manage the health of populations. Science. (2019)
  2. Author paper hosted by the Federal Trade Commission for PrivacyCon. (2019)

FROM EVIDENCE TO EXECUTIVE ACTION

What would this change in your organization?