Biased “Researchers” Playing Games with Numbers


Biased "Researchers" Playing Games with Numbers
Biased “Researchers” Playing Games with Numbers

Fairfax, VA – -( Stanford Law Professor John Donohue and Theodora Boulouta, a Stanford undergrad, wrote an opinion piece in the New York Times that claims their new research shows the 1994 “assault weapons” ban really did work.

Their finding is that, “Compared with the decade before its adoption, the federal assault weapon ban in effect from September 1994 through 2004 was associated with a 25 percent drop in gun massacres (from eight to six) and a 40 percent drop in fatalities (from 81 to 49).”

For some reason, Donohue and Boulouta chose to use six fatalities as the minimum, instead of the common definition of four or even the Obama-era attempt to reduce the threshold to three. Jacob Sullum at Reason has a pretty good guess as to why Donohue and Boulouta chose six: “Yet they chose to focus on cases with six or more fatalities, for no obvious reason except that it exaggerates the changes they attribute to the “assault weapon” ban that expired in 2004.” Sullum’s article is titled, “A Suspiciously Selective, Logically Shaky Analysis of Mass Shooting Data Claims the Federal ‘Assault Weapon’ Ban ‘Really Did Work’.”

Sullum uses the full Mother Jones dataset, including incidents in which three people were murdered (instead of the long-accepted threshold of four fatalities) and incidents that Mother Jones categorizes as a spree killing. So, while Sullum’s point about Donohue and Boulouta’s anything-but-arbitrary selection process is valid, his totals could be further refined to better meet the commonly accepted definition of a public mass shooting.

So that’s what we did. We limited the dataset to those identified by Mother Jonesas mass shootings and those with four or more fatalities. There were 15% fewer mass shootings during the so-called “assault weapons” ban than in the previous decade…but we’re talking about rare events so the 15% decrease is a shift from 13 to 11. There was a 32% decrease in fatalities. The prior decade included the Luby’s Cafeteria attack in Killeen, Texas. Excluding that case alters the decreases to 8% in incidents and 12% in fatalities.

See how a single incident among rare events can alter the calculated statistics?

Donohue and Boulouta appear to have used some additional case selection process in their analysis. Using the same database and looking only at mass shootings with six or more fatalities, we have seven incidents in the decade before the ban and six during the ban. Excluding weapons not legally acquired shifts the totals for each period down by one event (to six and five, respectively). There were still 48% more fatalities before the ban than during. Let’s look at the six cases from the decade before the shooting. Two involved semi-automatic variants of AK-style rifles and another involved a pair of Intratec DC-9 pistols. Here are what the other incidents involved:

  •      Three semi-automatic handguns – a .22 and two Colt 1911s
  •      Two semi-automatic handguns, a bolt-action rifle, two revolvers, and two shotguns
  •      An M1 carbine and a revolver
  •      Two semi-automatic handguns

Which of those firearms would have been prohibited under the so-called “assault weapons” ban?

Donohue and Boulouta deliberately chose a definition that allowed them to deliver the most dramatic change possible. They present this rudimentary analysis as evidence that the “assault weapons” ban is responsible for any change at all. They assert that the change must be because the law and the subsequent sunsetting allowed “the gun industry to flood the market with increasingly powerful weapons that allow for faster killing.”

Except none of that is true. Semi-automatic rifles in the years before the ban, those that were explicitly banned, those that were available during the ban, and those now available are functionally the same. Rates of fire and muzzle velocity have not changed. Donohue argues that, “assault weapons are semiautomatic firearms designed for rapid fire and combat use, and large capacity magazines increase the number of rounds that can be fired without reloading.” Semi-automatic firearms, as anyone familiar with guns or anyone not looking to manipulate an argument knows, fire a single round per trigger pull. They’re also not designed for combat use. Military forces generally use select-fire weapons that are capable of firing more than one round per trigger pull.

What is noticeably absent from this analysis is any consideration for the known contagion effect of mass shooters. Mass shooters seek fame, and media reports help deliver this to their twisted minds. One of the key differences between now and the 1980s, 1990s, and even the early 2000s is the proliferation of internet access and content available digitally. Information on mass shooters is readily available, allowing disturbed and deranged monsters the ability to obsess over mass shooters and helping their own twisted fantasies fester. The contagion effect is real, and should be considered in any sort of analysis – as well as a warning sign for potential mass shooters.

As mentioned above, Donohue is a Stanford Law professor. This doesn’t stop him from repeating the absurd anti-gun talking points about the Protection of Lawful Commerce in Arms Act. He claims that, “no other industry is allowed to act so recklessly without facing legal challenge. But a 2005 law immunized gun manufacturers for harm caused by the criminal use of firearms.” What industry is held responsible for the criminal use of its legally sold products, Professor?

Warning signs are often strung together after the fact – or ignored in real-time by authorities more interested in funding than safety, as in Parkland. No system – not even an “assault weapons” ban – will work if efforts are not made to utilize it.

Frankly, we expected more from Donohue and his newest co-author. Donohue has, in the past, attempted to position himself as a researcher. He appears willing now to out himself as an activist.  While we’re not sure if this opinion article is a precursor to an actual study, the choices made throughout the article suggest that – yet again – gun controllers let their desired outcome dictate the research design.

National Rifle Association Institute For Legislative Action (NRA-ILA)


Established in 1975, the Institute for Legislative Action (ILA) is the “lobbying” arm of the National Rifle Association of America. ILA is responsible for preserving the right of all law-abiding individuals in the legislative, political, and legal arenas, to purchase, possess and use firearms for legitimate purposes as guaranteed by the Second Amendment to the U.S. Constitution. Visit:

0 0 votes
Article Rating
Inline Feedbacks
View all comments

The words, New York Times and Washington Post, tell the intelligent person all they need to know.


Nothing different can be expected from a prof. Just think they are filling our heirs heads with the same erroneous BS.


Mark Twain on three kinds of lies: Lies, Damned lies, and Statistics.

Wild Bill

@Bowser, I dunno, “… CDC study which concluded that armed citizens prevent 2.4 to 3 million crimes a year.” is a pretty handy statistic!


The problem with any study of the effectiveness of the Clinton AWB was the ban defined AW’s as semi-auto rifles with more than a fixed number of features. I.E. An AW AR-15 had a flash suppressor, bayonet lugs & may have had an adjustable stock. A non AW AR-15 didn’t have adjustable stock, bayonet lug or flash suppressor. None of these features affect the cyclic rate of an AR-15. Also, the ban on civilian sales of mags over 10 round didn’t apply to used “high capacity” mags. Many LEO agencies & the DOD sold used magazines over the acquisition cost… Read more »


And that explains why the AR15 was an “assault weapon” while the Ruger Mini-14 was not. Cosmetics.

Green Mtn. Boy

Liars figure and figures lie and Leftards know nothing but lies.


Of course lamestream media and their consumers will trumpet this study, glibly beginning their narrative with “Studies have proven…”.


It’s a shame they can’t be convinced to quote the CDC study which concluded that armed citizens prevent 2.4 to 3 million crimes a year.

Get Out

The AWB was a deception of false safety, people woke up to the fact that the promises of safer streets had been empty and impotent. That’s also why it was allowed to sunset and not be renewed.

IMOA, They need to ban gun free zones where these mass shootings take place? These POS shooters are cowards and won’t want to chance they’ll meet someone armed to stop them.


One way to combat the contagion effect might be to assign the mass murderer a systematic name to be used in news reports. For instance, if there was a a mass shooting in Kansas today, we would henceforth refer to the murderer as “MMKS190921-01” in case, Heaven forbid, there’s more than one in a given state on a given day. This would allow as much discussion and analysis as anyone would care to engage in, while not emblazoning the papers and the airwaves with the culprit’s name. Indeed, the idea is to reduce their status, by making them just another… Read more »

Ryben Flynn

I believe firearm deaths were already on a downward trend before 1994 and continued afterwards. According to the FBI the ban had a negligible effect.


Also, the 1990’s was the decade of state by state passing concealed handgun licensing laws.


Proper critique of the study will never be mentioned by the media of course.


Figures don’t lie – but liars can figure.


Incredible took them 25 years to pencil with their numbers to invent something


I’ll bet the same fools that did this study are the same one’s that are pushing Climate Change is totally controllable by man!. All the idiots are in one basket!


Exactly, Mac. Pick any conclusion on any topic with any desired cause-effect relationship, and I’ll bet I can provide statistics to prove it. Then give me another day, and I’ll provide the stats that disprove it.