The Method of Multiple Working Hypotheses
T. C. Chamberlin · 1890 · Science · PDF (Stanford)
Hold multiple hypotheses simultaneously, or your favorite will blind you. The single "ruling theory" breeds parental affection; multiple working hypotheses breed impartiality.
The argument
Chamberlin identifies three stages in a scientist's intellectual development. The first is the ruling theory: a single explanation adopted early and defended against all comers. The second is the working hypothesis, an improvement that treats the explanation as tentative. But even a single working hypothesis invites "parental affection." The scientist unconsciously steers toward confirmation. Observations that fit are amplified; observations that don't are explained away or simply not noticed.
The remedy is to hold multiple hypotheses at once. When a geologist enters the field carrying three possible explanations for a formation, no single one commands loyalty. Each observation becomes a test rather than a vindication. The method forces the mind to distribute its attention across competing accounts, and the data itself sorts the field.
Chamberlin wrote this decades before psychologists gave confirmation bias its name. His insight was that the bias is not intellectual weakness but emotional attachment. The cure is structural: multiply the objects of attachment until no single one can dominate.
Discussion
Chamberlin's method sits at a specific point in the reasoning pipeline. Peirce's abduction generates hypotheses from surprising observations. Chamberlin's contribution is what happens next: hold them all, simultaneously, without ranking. The ranking comes from data, not from preference.
Popper (1934) supplied the elimination mechanism that Chamberlin left implicit. If a hypothesis is falsifiable and the data falsifies it, discard it. The surviving hypotheses are not confirmed, only not yet eliminated. Chamberlin anticipated this asymmetry without formalizing it.
Platt (1964) operationalized Chamberlin as "strong inference": enumerate hypotheses, design experiments that exclude at least one, run them, repeat. Platt's version added urgency. Chamberlin counseled patience; Platt turned it into a loop.
The method has a limitation that Chamberlin did not address. Generating the right set of hypotheses is the hard part. If the true explanation is not among your working set, no amount of impartial testing will find it. Peirce's abduction and Kuhn's paradigm shifts both deal with this problem. Chamberlin assumed the hypotheses were already on the table.
Failure mode
Every scientist who fell in love with one theory and ignored disconfirming evidence is an instance of what Chamberlin warned against. Lord Kelvin insisted on a young Earth because his thermodynamic calculations demanded it, dismissing geological and biological evidence that required vastly more time. He did not know about radioactive decay, but he also did not hold open the hypothesis that an unknown energy source might exist.
Linus Pauling spent his later career promoting vitamin C megadoses as a cancer treatment, interpreting ambiguous clinical results as support while dismissing controlled trials that showed no effect.
Fred Hoyle championed steady-state cosmology long after the cosmic microwave background radiation made the Big Bang the only viable account, reinterpreting the CMB data rather than updating.
In each case the scientist had earned enormous credibility in one domain and carried a single ruling theory into a question where it failed. Chamberlin's method would not have guaranteed the right answer, but it would have prevented the tunnel vision.
Integrity
The deepest demand of the method is wanting your hypotheses to be wrong. When you hold multiple hypotheses, discarding one is progress, not loss. Kelvin was brilliant. Pauling won two Nobel prizes. The failure was not cognitive but dispositional: they stopped wanting to be surprised.
Chamberlin framed this as a habit of mind that must be cultivated deliberately. Left to its own tendencies, the mind will adopt a favorite. The method of multiple working hypotheses is an intervention against that tendency, not a description of how scientists naturally think.
Neighbors
- Popper 1934 — falsifiability as the elimination mechanism Chamberlin left implicit
- Fisher 1935 — the statistical machinery for actually testing hypotheses
- Platt 1964 — strong inference extends Chamberlin: design experiments that discriminate between hypotheses
- ♟ Game Theory Ch.4 — dominated strategies and elimination: working hypotheses are eliminated by evidence, analogous to iterative dominance
- 🎰 Probability Ch.7 — Bayesian inference: multiple hypotheses with prior probabilities updated by evidence is Chamberlin formalized
External
Peirce on abduction (Wikipedia) — generating hypotheses from surprising data
- Platt 1964, "Strong Inference" (Science) — Chamberlin operationalized as a loop
Confirmation bias (Wikipedia) — the psychology Chamberlin diagnosed before it had a name