The Meditation Claim, Examined

This is the lesson where the course examines its own tradition. Lesson 1.4 promised it and Lesson 2.4 promised it again.

Here is the claim.

If enough people meditate together in one place, violence in the surrounding area falls.

It goes by several names and is usually presented with one particular study attached. That study is worth walking through slowly, because it is a good example of how evidence can be real, published, and useless at the same time.

Washington, In The Summer Of 1993

Between June and July of 1993, an organization associated with the Transcendental Meditation movement assembled roughly four thousand practitioners in Washington, DC. The stated purpose was to reduce violent crime in the city. The results were published six years later in a social science journal, by authors affiliated with the organization's own university and policy institute.

The reported finding was a decrease in violent crime of up to 23.3 percent.

That number has been repeated for thirty years, usually with the words "peer reviewed" attached. Here is what sits underneath it.

The comparison was to a prediction, not to a measurement. This is the central problem and everything else is secondary. The reported decrease was not a drop against the previous summer, or the previous month, or any other summer. It was a drop against a projected figure that described what the researchers calculated crime would have been if the assembly had not happened. That projection was built by the same people making the claim, using a model of their own construction. If you are permitted to specify the number that would have occurred, you can report a decrease from any number that actually did.

Murders went up. Over that period the homicide count in the city rose, and 1993 was one of the worst years for killings in the city's recorded history. The single least ambiguous measure of violence available moved in the wrong direction. The reported reduction came from a composite figure covering several offense categories, adjusted for temperature.

The number is a maximum, not an average. It describes the best point in a modeled series, not the effect across the period, which is not how the figure gets quoted.

The model had a great many choices in it. Violent crime swings seasonally, and DC in the early 1990s was near a historic peak with enormous week to week variation. Under those conditions, decisions about which weather variables to control for, which offenses to combine, and which window to examine largely determine the answer. The researchers made every one of those decisions themselves.

Nobody outside the movement has reproduced it. Nearly the entire published literature supporting this effect is produced by people affiliated with the organization making the claim. That does not automatically make it false. It does mean the claim has never survived contact with anybody who would be pleased to find it wrong, and surviving that contact is the entire purpose of evidence.

The Standard From Module Seven

Module Seven asked you to accept a finding about nonviolent campaigns, and it showed you the arguments against that finding rather than hiding them. It is worth being explicit about what made that evidence usable, because it is the same list every time.

Have the sentence you wrote at the end of Lesson 7.1 in front of you while you read the next part, the belief of your own that you ran these four items against, because what follows is the same procedure run on somebody else's.

The data was assembled so other people could check it, and they did. Some of them wanted it to be false. A few of their objections held up and changed how the finding is now stated. And the comparison was to what happened, not to what a model calculated was going to happen.

Apply that standard here and the meditation studies fail on the first item and never reach the fourth.

Why This Was Always Going To Fail

There is a reason the claim was in trouble before anybody examined a single number, and you have had that reason since Module Two.

The claim says that something occurring on the first rung produces an effect on the fourth, with nothing in between. No mechanism. No intermediate step. Nothing that would have to be true along the way, and therefore nothing that could be checked separately. Every arrangement you have studied since then, every incentive and institution and pillar of support, is simply skipped over.

That is precisely the error the ladder exists to catch. Each rung runs on its own machinery. A claim that a first rung intervention moves a fourth rung outcome, and cannot say through what, is not an ambitious claim. It is a claim with the middle missing.

What Is Left

Lesson 1.4 promised that this course would report what remains defensible once the inflated claims are removed. That is the rest of this lesson, and it is a much smaller pile than the one we just knocked over.

This course has made three claims about inner work, twice, in the same words. Accuracy, resistance, endurance. Having spent a lesson demanding evidence from somebody else, it now has to produce its own.

Accuracy is the best supported of the three, and the support is modest.

Attention training does measurably change what people notice. Practiced meditators detect things others miss, hold attention longer on tasks built to be tedious, and show a smaller gap between an event and their awareness of reacting to it. These findings replicate reasonably well.

Now the honest part. The effects are small, and many of the studies are small too. This field also has a problem it cannot solve, which is that you cannot blind somebody to whether they are meditating. Everyone in such a study knows which group they are in, and people who volunteer expect it to work. Compared against an active alternative rather than against people doing nothing, the effects shrink.

So the claim survives in the reduced form the course stated it in. You become a somewhat more accurate observer, over a long period, by a modest amount. That is what was promised and it is what the evidence carries.

Resistance is the weakest of the three and the course is going to say so.

There is no study showing that people who meditate refuse unethical instructions at higher rates than people who do not. Nobody has run it well, and it would be hard to run well.

The claim rests on an inference, and you should see the whole of it and judge. Module Three named the conditions under which ordinary people go along: increments too small to object to, distance from the consequence, responsibility divided until nobody holds a whole piece, and nobody else visibly hesitating. Every one of those is defeated by noticing in time, and attention practice is training in noticing in time. So a demonstrated capacity plugs into a demonstrated mechanism.

That is a reasonable expectation. It is not a finding, and this course will not present it as one. If the difference between those two things seems like a technicality to you, this lesson has failed.

Endurance has some support and it is the whole subject of the next module.

Research with people in high exposure occupations, medical staff and emergency responders and others who deal with distress as a condition of employment, has found modest benefits from contemplative training on burnout and on some of the physical markers that accompany it. The same cautions apply. Small studies, volunteers, expectation effects. Module Nine takes this up properly.

Three modest claims survive. The large one does not. The distance between what can be defended and what has been sold is most of what has gone wrong with this tradition.

One Thing In Fairness

Nothing here says that meditation does nothing, and nothing here says the people who assembled in Washington were dishonest.

Most of them believed the claim, and many of them had good private reasons to. The practice had done something real for them. It is natural to think that a thing which helped you would help at scale, and more natural still to think that if it helped one person it would help a city if you had enough people.

That step, from this changed me to enough of this changes everything, is the specific error. It is the ladder error, made sincerely, by people whose experience of the first rung was genuine. You will meet the same step everywhere somebody has generalized from a real personal result to a claim about societies, and it is nearly always made in good faith.